-- Logs begin at Fri 2022-06-24 08:28:07 UTC, end at Fri 2022-06-24 09:27:13 UTC. -- Jun 24 08:56:02.314888 dv-cinder-845990-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 08:56:02.322546 dv-cinder-845990-4-smb devstack@keystone.service[80242]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:56:02 2022] *** Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: nodename: dv-cinder-845990-4-smb Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: machine: x86_64 Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: clock source: unix Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: pcre jit disabled Jun 24 08:56:02.324513 dv-cinder-845990-4-smb devstack@keystone.service[80242]: detected number of CPU cores: 4 Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: current working directory: / Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: your processes number limit is 47680 Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: your memory page size is 4096 bytes Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: detected max file descriptor number: 2048 Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: lock engine: pthread robust mutexes Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: thunder lock: enabled Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 08:56:02.325018 dv-cinder-845990-4-smb devstack@keystone.service[80242]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:56:02.369347 dv-cinder-845990-4-smb devstack@keystone.service[80242]: Python main interpreter initialized at 0x55f0cefd99c0 Jun 24 08:56:02.369347 dv-cinder-845990-4-smb devstack@keystone.service[80242]: python threads support enabled Jun 24 08:56:02.369347 dv-cinder-845990-4-smb devstack@keystone.service[80242]: your server socket listen backlog is limited to 100 connections Jun 24 08:56:02.369347 dv-cinder-845990-4-smb devstack@keystone.service[80242]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:56:02.369734 dv-cinder-845990-4-smb devstack@keystone.service[80242]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:56:02.369810 dv-cinder-845990-4-smb devstack@keystone.service[80242]: *** Operational MODE: preforking *** Jun 24 08:56:02.370072 dv-cinder-845990-4-smb devstack@keystone.service[80242]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:56:02.370072 dv-cinder-845990-4-smb devstack@keystone.service[80242]: spawned uWSGI master process (pid: 80242) Jun 24 08:56:02.370292 dv-cinder-845990-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 24 08:56:02.371317 dv-cinder-845990-4-smb devstack@keystone.service[80242]: spawned uWSGI worker 1 (pid: 80253, cores: 1) Jun 24 08:56:02.371317 dv-cinder-845990-4-smb devstack@keystone.service[80242]: spawned uWSGI worker 2 (pid: 80254, cores: 1) Jun 24 08:56:02.371848 dv-cinder-845990-4-smb devstack@keystone.service[80242]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:56:07.793087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:56:07.793087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: from cryptography.utils import int_from_bytes Jun 24 08:56:07.793867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:56:07.793867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Jun 24 08:56:07.794306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:56:07.794306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: from cryptography.utils import int_from_bytes Jun 24 08:56:07.794421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:56:07.794421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Jun 24 08:56:07.842598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:56:07.842749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:56:07.842836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:56:07.842951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:56:07.843030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] command line args: [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:56:07.843149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] command line args: [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:56:07.843231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:56:07.843400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ================================================================================ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:56:07.843477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:56:07.843586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ================================================================================ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:56:07.843668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] admin_token = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.843839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.843916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] config_dir = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_dir = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] config_source = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] debug = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_source = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] debug = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.844966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.845982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_config_append = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_config_append = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_dir = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_dir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.846943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.847057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.847138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.847244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.847814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.847932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.848925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.849859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.850019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.850146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.850283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.850372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.850562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.850646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] publish_errors = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] publish_errors = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.851896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] standard_threads = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] standard_threads = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.852840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] use_journal = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_journal = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_json = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] use_json = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_stderr = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] use_stderr = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_syslog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.853916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] use_syslog = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.854063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.854146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:56:07.854341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.854420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.854580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.854664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.854837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.854922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855403 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.855877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856280 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856601 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.856854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.857991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.858981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.859959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.860970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.861908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.862880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.863604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.863690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.863841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.863924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.864985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.865063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.865213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.865547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.865699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.865774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.865933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.866974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.867915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.868968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.869984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.870933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.871959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.872873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873809 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.873968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.874930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.875968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.876893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.877961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.878958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.879929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.external = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.external = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.880926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.password = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.token = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.password = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] auth.token = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.881855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.882995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.883959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.884971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.885954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.886995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.887939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.888900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.889868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.890999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.891937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.892954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.893922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.894090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.894751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.894877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.895934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.896967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.897978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.898901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899279 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.899905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900794 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.900918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.901928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.902995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.903877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.904995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.905891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.906947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.907961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.908974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.909127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.909254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.909378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.909502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.909625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.909755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.910439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.910607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.910729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.910849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.910999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.911900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.912907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.913898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.914992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.915933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] role.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] role.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.916945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.917953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.918969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.919946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.920182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.920304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.920304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.920621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.920823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.920823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.921187 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.921347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.921347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.921687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.921899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.922096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.922353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.922353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.922718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.922875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.922875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.923956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.924832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.925118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.928939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.929961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.930884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.931924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.932964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.933879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:56:07.934545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.934837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.935075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.935293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.935532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.935774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.936015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.936253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.936501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.936821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.937070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.937306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.937558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.937797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.938042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.938303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.938547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.938784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:56:07.938954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:56:07.971202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.971457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.971588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.971735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.971887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.972018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.981691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:07.983922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.013054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.013434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.015277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.015504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.159399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.166502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.210195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.210447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.216565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.216807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.277908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.278019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.278111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.278260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.304798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.304951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.305974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.306103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.306184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.317824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.318211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.330959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.331194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.331420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.331617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.331700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.331861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.331942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80254) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.332926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:56:08.350396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.350607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:56:08.351167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.351441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:56:08.351573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.351712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.351794 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:56:08.351969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.352107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.352226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.352305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:56:08.352480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.352562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.352807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.353071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.353328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.364163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.364437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.364702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.364784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.364978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.365071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.365245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.365779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.373860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.375032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.377167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.377446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.377725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.378001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.378301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.378383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.378586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.378668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.378854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.378934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.379919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.380007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.380198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.380467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.380738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.381005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.406613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.408218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.408300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.408496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.410534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.410765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.414733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.415125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.415404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.416908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.417303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.417588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.422648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.422935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.424884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.425170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.427461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.427742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.428020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.428300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.428575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.428847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.429113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.429374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.429803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.430087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.430391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.430801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.431128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.431576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.432028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.432488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.448951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.449221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.452419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.452897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.454296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.458050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.458462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.458857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.461800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.462207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.464126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.467235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.467733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.470859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.471492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.471789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.472073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.472379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.472652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.472926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.475464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.475768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.476056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.476339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.476618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.476907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.492468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.492749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.493013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.493287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.496601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.497080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.497552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.498030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.501322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.503039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.503317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.507797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.508098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.508398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.508701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.509040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.509878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.511615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.511893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.515128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.515409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.515688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.515978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.516259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.522753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.523031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.523325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.523607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.525269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.525559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.525849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.531041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.531324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.531612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.531895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.533581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.533875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.534173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.543919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.547213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.550610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.552552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.553030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.554724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.555004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.555284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.556371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.559684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.561426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.562595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.563102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.563381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.563673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.564478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.568221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.568517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.568912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.569187 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.572465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.574099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.577359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.577649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.578041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.578350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.578658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.578943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.579221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.587588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80254) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.587867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.588000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.588144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.588288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.588414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.588569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.588682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.589051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.589335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.589603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.589869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.590145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.590443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.590704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.590977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.591365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80254) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.597380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:56:08.597664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.597948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.598249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.598530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.598912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.599199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.599479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.599751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.600030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.600302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.600581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.600850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.601127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:56:08.630297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0cefd99c0 pid: 80254 (default app) Jun 24 08:56:08.634002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5c7e4-5cbe-4948-abd0-d2909dc62a9e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:08.634323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5c7e4-5cbe-4948-abd0-d2909dc62a9e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:08.634606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5c7e4-5cbe-4948-abd0-d2909dc62a9e None None] PATH_INFO: `/v3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:08.638787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Fri Jun 24 08:56:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:08.641428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0cefd99c0 pid: 80253 (default app) Jun 24 08:56:16.257537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:16.258100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:16.258100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:16.259445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:56:16.267297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:16.267719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:16.267870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:16.336465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: INFO dbcounter [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] Registered counter for database keystone Jun 24 08:56:16.357674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG oslo_db.sqlalchemy.engines [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:56:16.364117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writer thread running {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:56:16.540206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80253) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 08:56:16.540618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80253) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 08:56:16.595232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:16.596822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:16.715914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 08:56:16.863308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:16.933325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: INFO dbcounter [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] Registered counter for database keystone Jun 24 08:56:16.952798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG oslo_db.sqlalchemy.engines [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:56:16.958936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writer thread running {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:56:17.077692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3730c6e-af1d-42d9-a2e1-d1de72bef444 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:17.082421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:17.083077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:17.083360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:17.083636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:17.091610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:17.143242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING keystone.common.rbac_enforcer.enforcer [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 08:56:17.143528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea1161-8c2d-4956-8111-745cc598b92c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:17.153419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jun 24 08:56:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:56:17.159421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:17.174433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1922f0b-4c99-489c-8ea8-50dbb7fcf295 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:17.178888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:17.180020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:17.180313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:17.180594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] PATH_INFO: `/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:17.184696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] RBAC: Authorizing `identity:get_project(project_id=a2c438c1ae4c4814acf705cd2b5ad9d9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:17.235639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 08:56:17.235989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c950d6-8006-403f-b81d-34f370bd21ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:17.240841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jun 24 08:56:17 2022] GET /identity/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:19.235500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d985f-b559-4651-b7da-b2cf4d4844aa None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:19.235986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d985f-b559-4651-b7da-b2cf4d4844aa None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:19.236084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d985f-b559-4651-b7da-b2cf4d4844aa None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:19.240974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:19.246336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:19.246704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:19.246902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:19.265922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:19.267456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:19.275377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 08:56:19.298720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d985f-b559-4651-b7da-b2cf4d4844aa None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:19.311244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d985f-b559-4651-b7da-b2cf4d4844aa None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:19.315503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db3d26-a57c-4be5-8e85-ee42efcd1c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:19.316664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3d26-a57c-4be5-8e85-ee42efcd1c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:19.316945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3d26-a57c-4be5-8e85-ee42efcd1c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:19.317223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3d26-a57c-4be5-8e85-ee42efcd1c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:19.324850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3d26-a57c-4be5-8e85-ee42efcd1c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:19.326659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db3d26-a57c-4be5-8e85-ee42efcd1c6d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:19.335948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jun 24 08:56:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:56:19.341217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:19.350863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840df6c3-3b32-4a6f-b66a-30012ef5fe58 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:19.355212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764585e3-b169-4990-9a4a-530a0fc0dfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:19.356068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764585e3-b169-4990-9a4a-530a0fc0dfec admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:19.356350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764585e3-b169-4990-9a4a-530a0fc0dfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:19.356622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764585e3-b169-4990-9a4a-530a0fc0dfec admin admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:19.358006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764585e3-b169-4990-9a4a-530a0fc0dfec admin admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:19.359857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764585e3-b169-4990-9a4a-530a0fc0dfec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:19.361432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jun 24 08:56:19 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:21.427891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b220a6-bb45-4359-bc35-416e6f2cf9a6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.428412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b220a6-bb45-4359-bc35-416e6f2cf9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.428505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b220a6-bb45-4359-bc35-416e6f2cf9a6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.429809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:21.434846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.435265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.435418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.452377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:21.453545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:21.455784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bf34-2b47-4930-8929-8ade7d61de6f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.456075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bf34-2b47-4930-8929-8ade7d61de6f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.456356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bf34-2b47-4930-8929-8ade7d61de6f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.457693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 7/11] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:56:21.462675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.462971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.463254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.502635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG passlib.handlers.bcrypt [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80254) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 08:56:21.503748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG passlib.handlers.bcrypt [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80254) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 08:56:21.535336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:21.549443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:21.551048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:21.558383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:21.582176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:21.651548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:21.660957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcba660-d6c2-4296-95c5-ac6b2d8458a4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:21.673298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:21.695663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:21.696391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.696671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.696941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.707773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:21.718847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:21.719898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:21.720804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 6/14] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:21.725829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:21.774529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79383663-39b5-48c0-8564-6de0d3092a6c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:21.777172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:21.809644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:21.811441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:21.812332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.812626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.812905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.828127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24544ab8-b55e-4d30-ae11-733c1b9c2351 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:21.861431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:21.862090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:21.862412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:21.863269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:21.864025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:21.864336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:21.865979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:21.877562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 7/15] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:21.878948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:21.880473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:21.883030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:21.976357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:21.981584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee30da-cbda-4c7c-93df-aa2dd6bee012 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:21.982009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:21.984687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:22.016628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:22.017506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:22.017792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:22.018070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:22.019346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:22.020833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:22.022487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:21 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:22.027731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:22.042759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:22.086025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979cafc-a31f-44b2-a0a5-716b31b22012 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:22.119842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:22.120630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:22.120912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:22.121192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:22.129157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dfd50-c84a-42a3-a39a-9f6a91fa6d03 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:22.141662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:22.143289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:22.162568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:22.163365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:22.163650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:22.163930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:56:22.164208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:22.165123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:22.166112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:56:22.166112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:56:22.166112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:56:22.166112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:22.166112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:22.167225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:22.168666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:22.170625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:22.171532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:22.176141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:22.227684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:22.255690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:22.273215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637f97e-77f5-4af2-9e13-41f292f7cd5a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:22.275878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d76e-4b3f-4373-8c86-91905629ff31 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:22.306179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:22.306862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:22.307151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:22.307431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:22.308156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:22.308465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:22.308764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:22.309419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:22.309706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:22.309852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f37c4e-4594-4919-ab45-c22f02a5ade0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:22.309986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:22.310861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.domain.id=default, user.id=6a27e99cfbbf4208a8877f4098e73599) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:22.311175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:22.312771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c082d8f-b452-4a51-ac0e-de4dda88008a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:22.320514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Jun 24 08:56:22 2022] GET /identity/v3/role_assignments?user.id=6a27e99cfbbf4208a8877f4098e73599&scope.domain.id=default&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:22.328019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:24.566206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40f9a-6e8b-422a-a3bb-f7e6d9d874ea None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:24.566725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40f9a-6e8b-422a-a3bb-f7e6d9d874ea None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:24.566797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f40f9a-6e8b-422a-a3bb-f7e6d9d874ea None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:24.568144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:24.579810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:24.580278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:24.580358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:24.603210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:24.604399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:24.688021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a419-0a45-4bee-80f3-3aec5a64d00e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:24.688328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a419-0a45-4bee-80f3-3aec5a64d00e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:24.688583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1a419-0a45-4bee-80f3-3aec5a64d00e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:24.690121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:56:24.692615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:24.710124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:24.710438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:24.710721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:24.718857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:24.748548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:24.749727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:24.833982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:24.922703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:24.940564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645d187-deb0-4c39-b02a-f07f2f0902da None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:24.960803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.010177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.011000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.011281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.011555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.039404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:25.049720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:25.051202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:25.051956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:25.054823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:25.061010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.142599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:25.214687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b5cd9-dc87-4483-bc9c-844e309db18a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.216825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2d1b8-1090-42d9-9ba9-afb2168f9a1c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.223279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:25.253948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.254904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.255341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.255756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.256654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:25.257095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.258641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e459c5-3959-4707-9b60-a0f0796fbda3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.271789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 14/27] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:25.273514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a56ef-366f-4505-8724-5ba253fe94c2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.273992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a56ef-366f-4505-8724-5ba253fe94c2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.274479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a56ef-366f-4505-8724-5ba253fe94c2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.275881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:25.281211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a56ef-366f-4505-8724-5ba253fe94c2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.331532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.332336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.332782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.333229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.349411 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.350924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bf645655-ec73-497c-96e2-7ef1b1757091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:56:25.388812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:25.389820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:25.390804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:56:25.390804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:56:25.390804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:56:25.390804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:25.393024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 14/29] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:25.394536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.394956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.395365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.409757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a56ef-366f-4505-8724-5ba253fe94c2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.415404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:25.416723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:25.445757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29798f7a-d287-474c-8545-3ae036f61ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.446889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29798f7a-d287-474c-8545-3ae036f61ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.447334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29798f7a-d287-474c-8545-3ae036f61ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.447747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29798f7a-d287-474c-8545-3ae036f61ce5 None admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.449438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29798f7a-d287-474c-8545-3ae036f61ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.451081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29798f7a-d287-474c-8545-3ae036f61ce5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.452884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:25 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:25.459276 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936da35-6f02-403a-9b16-0863b0e59636 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.459742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936da35-6f02-403a-9b16-0863b0e59636 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.460162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936da35-6f02-403a-9b16-0863b0e59636 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.461611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 17/31] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:25.466446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936da35-6f02-403a-9b16-0863b0e59636 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.495846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 15/32] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:25.498997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.518043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:25.574712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:25.608174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936da35-6f02-403a-9b16-0863b0e59636 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.616874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8003d5-5ea5-40b2-bbf9-c786fcf0afd7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.651746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.652291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556665-ce07-47d3-ac46-d246ca5d6bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.652638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.652919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.653190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.653767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556665-ce07-47d3-ac46-d246ca5d6bbc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.653924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:25.654255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.654496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556665-ce07-47d3-ac46-d246ca5d6bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.654909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556665-ce07-47d3-ac46-d246ca5d6bbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.655660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.656405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556665-ce07-47d3-ac46-d246ca5d6bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.658289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556665-ce07-47d3-ac46-d246ca5d6bbc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.660746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:25.666443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.666998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.667464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.673641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:25.673641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.689935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:25.691543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:25.777594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:25.783754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:25.785196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:25.785943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dc7b6-5fb6-4684-a12b-7bdc41b7056f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.829322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.830967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.831486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.831980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.833143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.835584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.863248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:25.913272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c109ee-0648-4449-a528-0982de1fdc64 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:25.951172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:25.952047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:25.952330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:25.952607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] PATH_INFO: `/v3/domains/default/users/6a27e99cfbbf4208a8877f4098e73599/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:25.954670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6a27e99cfbbf4208a8877f4098e73599, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:25.956269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:25.993889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 08:56:25 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:25.995183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:26.109404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1361 bytes} [Fri Jun 24 08:56:25 2022] PUT /identity/v3/domains/default/users/6a27e99cfbbf4208a8877f4098e73599/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:26.110881 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:26.111592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b00cc-1fcc-4c41-9cb4-a4e2b942fa5f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:26.155053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04624f-ec24-4e88-afca-3ee0294b69b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:26.156171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04624f-ec24-4e88-afca-3ee0294b69b4 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.156664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04624f-ec24-4e88-afca-3ee0294b69b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.157151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04624f-ec24-4e88-afca-3ee0294b69b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.158141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04624f-ec24-4e88-afca-3ee0294b69b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:26.160938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04624f-ec24-4e88-afca-3ee0294b69b4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:26.214006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:56:25 2022] POST /identity/v3/projects => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:26.215500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764611-95af-4f32-94bf-7b395aa0fccb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.215797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764611-95af-4f32-94bf-7b395aa0fccb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.216083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87764611-95af-4f32-94bf-7b395aa0fccb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.217573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:26.225037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.225516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.225950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.247225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff9320-b98e-44d7-bcc7-58d6a83ee9b8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:26.247670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:26.249453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:26.252272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:26.270489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:26.301120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11a95f-68f7-4c61-b33f-7602c3e89f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:26.301826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a95f-68f7-4c61-b33f-7602c3e89f6d None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.302137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a95f-68f7-4c61-b33f-7602c3e89f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.302423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11a95f-68f7-4c61-b33f-7602c3e89f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.303970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11a95f-68f7-4c61-b33f-7602c3e89f6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:26.305679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11a95f-68f7-4c61-b33f-7602c3e89f6d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:26.331129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 08:56:26 2022] POST /identity/v3/roles => generated 225 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:26.333893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de196b0-6bbf-499f-ba0b-0a48243d2b7b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.334594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de196b0-6bbf-499f-ba0b-0a48243d2b7b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.335099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de196b0-6bbf-499f-ba0b-0a48243d2b7b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.338270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:26.341111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:26.347483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.347483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.347483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.369195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:26.371252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:26.372895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:26.484070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:26.517247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db82e-dfef-42f8-85e8-e2b394ab6621 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:26.519777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:26.562898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:26.563664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.563955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.564234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.565007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:26.567763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:26.581916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:26.592762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 08:56:26 2022] POST /identity/v3/roles => generated 223 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:56:26.755320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269386da-7487-4e9c-a632-c0c7e29d6ca0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:26.758582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:26.794643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9610910-bafc-45c2-973e-eae71d57461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:26.795450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610910-bafc-45c2-973e-eae71d57461c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.795747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610910-bafc-45c2-973e-eae71d57461c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.796032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9610910-bafc-45c2-973e-eae71d57461c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.797272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9610910-bafc-45c2-973e-eae71d57461c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:26.798781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9610910-bafc-45c2-973e-eae71d57461c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:26.800482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:26.806213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:26.908253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283db12-8f6a-4db6-ba25-c4260f36d109 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:26.941917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476d6bd-ae44-45bf-9601-5a4b531c5f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:26.942606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d6bd-ae44-45bf-9601-5a4b531c5f03 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:26.942897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d6bd-ae44-45bf-9601-5a4b531c5f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:26.943180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476d6bd-ae44-45bf-9601-5a4b531c5f03 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:26.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d6bd-ae44-45bf-9601-5a4b531c5f03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:26.945363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476d6bd-ae44-45bf-9601-5a4b531c5f03 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:26.971894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:56:26 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:56:28.331914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58051-b56a-4cb2-86af-7bb76f846a2b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.332394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58051-b56a-4cb2-86af-7bb76f846a2b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.332394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b58051-b56a-4cb2-86af-7bb76f846a2b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:28.333782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:28.339069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.339471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.339763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:28.356025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:28.357193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:28.402619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:28.424372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:28.448426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58051-b56a-4cb2-86af-7bb76f846a2b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:28.547442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b58051-b56a-4cb2-86af-7bb76f846a2b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:28.581623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:28.582497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.582730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.583006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:28.593046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:28.600621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:28.601596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:28.602730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:28.607512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:28.702251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4930-efe3-4be0-8ef7-a3da4905b923 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:28.736037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:28.736699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.736984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.737286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:28.738036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:28.738440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:28.739821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:28.748078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:28.754105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:28.785334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:28.854060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9b02b-af6d-499a-a520-aa4d158818a9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:28.887359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad9e81-efd9-4002-9169-220ac51f40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:28.888232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad9e81-efd9-4002-9169-220ac51f40d0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.888517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad9e81-efd9-4002-9169-220ac51f40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.888795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad9e81-efd9-4002-9169-220ac51f40d0 None admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:28.889989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad9e81-efd9-4002-9169-220ac51f40d0 None admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:28.891475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad9e81-efd9-4002-9169-220ac51f40d0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:28.893134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:28 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:28.899097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:28.975519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9f37-1126-456b-8d4f-410d0750ac5f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.975808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9f37-1126-456b-8d4f-410d0750ac5f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.976095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9f37-1126-456b-8d4f-410d0750ac5f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:28.977518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 26/52] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:56:28.983155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:28.983446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:28.983725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:29.001842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:29.003652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:29.050330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:29.071641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 27/53] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:29.094974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:29.106847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff007ea-d362-494d-ab30-1b6808dfb035 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:29.123689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:29.139854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:29.140646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:29.140931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:29.141208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:29.142413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:29.144358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:29.146115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:29.151615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:29.193022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755facd-9ece-40bc-afe5-9fa53d0bb3d7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:29.225134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:29.225928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:29.226209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:29.226512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:29.227687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:29.229127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:29.230784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:29.236091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:29.248854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b2afa-bd90-437e-80e2-aad9ff25b354 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:29.259395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:29.282511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:29.283161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:29.283452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:29.283725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:29.285114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.domain.id=default, user.id=6a27e99cfbbf4208a8877f4098e73599) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:29.285422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:29.286964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77664273-aaf6-4c4c-a01c-ff5c43495b82 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:29.295803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1322 bytes} [Fri Jun 24 08:56:29 2022] GET /identity/v3/role_assignments?user.id=6a27e99cfbbf4208a8877f4098e73599&scope.domain.id=default&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:29.342441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:29.347528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290432ea-0ac7-4398-acce-0d2c05b54353 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:29.384425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa27f76-48b9-4f5f-a35f-c5a2d08a4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:29.385120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27f76-48b9-4f5f-a35f-c5a2d08a4afa None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:29.385486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27f76-48b9-4f5f-a35f-c5a2d08a4afa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:29.385835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa27f76-48b9-4f5f-a35f-c5a2d08a4afa None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:29.386677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa27f76-48b9-4f5f-a35f-c5a2d08a4afa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:29.388185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa27f76-48b9-4f5f-a35f-c5a2d08a4afa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:29.418213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Jun 24 08:56:29 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:56:31.441328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eb12d-4ed2-4d86-b338-d721a1b34864 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:31.441830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eb12d-4ed2-4d86-b338-d721a1b34864 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:31.441911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eb12d-4ed2-4d86-b338-d721a1b34864 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:31.443287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:31.448308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:31.448708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:31.448886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:31.465877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:31.467093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:31.531423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:31.556029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eb12d-4ed2-4d86-b338-d721a1b34864 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:31.654366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eb12d-4ed2-4d86-b338-d721a1b34864 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:31.686373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3c16a-45cb-45f9-9029-7eb5180071fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:31.687151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3c16a-45cb-45f9-9029-7eb5180071fd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:31.687438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3c16a-45cb-45f9-9029-7eb5180071fd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:31.687716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3c16a-45cb-45f9-9029-7eb5180071fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:31.688889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3c16a-45cb-45f9-9029-7eb5180071fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:31.690882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3c16a-45cb-45f9-9029-7eb5180071fd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:31.692512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:31.697652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:31.778030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:31.796634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfed64b-5d05-4db4-9591-4990c35af930 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:31.828948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80febba-96d2-426f-9606-eb030da95e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:31.829612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80febba-96d2-426f-9606-eb030da95e8b None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:31.829900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80febba-96d2-426f-9606-eb030da95e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:31.830181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80febba-96d2-426f-9606-eb030da95e8b None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:31.831486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80febba-96d2-426f-9606-eb030da95e8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:31.832911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80febba-96d2-426f-9606-eb030da95e8b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:31.856125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:56:31 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:56:34.867492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdaea1-6507-4655-a7bc-59460312b4a5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:34.868000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdaea1-6507-4655-a7bc-59460312b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:34.868073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdaea1-6507-4655-a7bc-59460312b4a5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:34.869420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:34.887620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850e22-e3e3-44ce-b283-e6ec0c37db52 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:34.888059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850e22-e3e3-44ce-b283-e6ec0c37db52 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:34.888181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9850e22-e3e3-44ce-b283-e6ec0c37db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:34.915251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f9850e22-e3e3-44ce-b283-e6ec0c37db52 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:34.916728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f9850e22-e3e3-44ce-b283-e6ec0c37db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:35.010300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:35.053332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdaea1-6507-4655-a7bc-59460312b4a5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.125880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:35.185482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440545b-2a1a-4bc1-b914-20930b378ed9 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.186035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440545b-2a1a-4bc1-b914-20930b378ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.186542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440545b-2a1a-4bc1-b914-20930b378ed9 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.188134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:35.193630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.193923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.194207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.201659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdaea1-6507-4655-a7bc-59460312b4a5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.223948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:35.225168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:35.265254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.266057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.266369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.266652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.286501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:35.294326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:35.295212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:35.295974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 32/65] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:35.307238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.342605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:35.354683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:35.386755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.467127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55c77d-8121-42b7-b765-82e6b0032426 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.469582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:35.496968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d79564-996d-42fc-bfbf-d911a603cdaa None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.520405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.521302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.521724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.522164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.523073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:35.524312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:35.525833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d432f-c647-4afc-8f87-3cde7417c188 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:35.535040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 33/67] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:35.536565 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bab4f-c786-4e25-b879-0e2c07cad681 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.536991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bab4f-c786-4e25-b879-0e2c07cad681 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.537415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bab4f-c786-4e25-b879-0e2c07cad681 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.538893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 34/68] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:35.543646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bab4f-c786-4e25-b879-0e2c07cad681 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.546093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7373c0-6aaa-4a8c-bdd4-162304fb42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.547122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7373c0-6aaa-4a8c-bdd4-162304fb42bb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.547413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7373c0-6aaa-4a8c-bdd4-162304fb42bb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.547695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7373c0-6aaa-4a8c-bdd4-162304fb42bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.562083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7373c0-6aaa-4a8c-bdd4-162304fb42bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bf7373c0-6aaa-4a8c-bdd4-162304fb42bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:35.571821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:35.572676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:35.573427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:35.574251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.574686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.575099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.593116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:35.594481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:35.653323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:35.671172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 36/70] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:35.672216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.682854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bab4f-c786-4e25-b879-0e2c07cad681 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.719395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec5b4a-89e1-4b25-a08e-168a88227bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.720494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec5b4a-89e1-4b25-a08e-168a88227bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.720921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec5b4a-89e1-4b25-a08e-168a88227bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.721990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec5b4a-89e1-4b25-a08e-168a88227bd8 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.738323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec5b4a-89e1-4b25-a08e-168a88227bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:35.739797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec5b4a-89e1-4b25-a08e-168a88227bd8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:35.745977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:35.745977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1e0aa-f574-4673-abee-d62c5d4bace1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.745977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1e0aa-f574-4673-abee-d62c5d4bace1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.745977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1e0aa-f574-4673-abee-d62c5d4bace1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.745977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 36/72] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:35.745977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1e0aa-f574-4673-abee-d62c5d4bace1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.770561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:35.787499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0b794-ffd8-4add-908d-9ba52b08750e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.822091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.822788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.823076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.823356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.824108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:35.824417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:35.825807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:35.833858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:35.834660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:35.854747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1e0aa-f574-4673-abee-d62c5d4bace1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.883278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:35.889218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c9b7-8a1b-484b-9fd9-f3efdaf43e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.890015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c9b7-8a1b-484b-9fd9-f3efdaf43e4d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.890330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c9b7-8a1b-484b-9fd9-f3efdaf43e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c9b7-8a1b-484b-9fd9-f3efdaf43e4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.900543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c9b7-8a1b-484b-9fd9-f3efdaf43e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b1c0c9b7-8a1b-484b-9fd9-f3efdaf43e4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:35.908348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:35.909219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 37/74] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:35.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627af92-f4c7-4625-b9ac-2101aac769b7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.911777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627af92-f4c7-4625-b9ac-2101aac769b7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.911777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627af92-f4c7-4625-b9ac-2101aac769b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.927606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7627af92-f4c7-4625-b9ac-2101aac769b7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:35.928801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7627af92-f4c7-4625-b9ac-2101aac769b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:35.935902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905f8d-c8b2-417b-a1c5-81909ef4fe42 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:35.969219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:35.969862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.970148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.970533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.994686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 38/75] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:35.996159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278ff2a-0930-42d8-926c-c3c016fa0bcf None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:35.996455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278ff2a-0930-42d8-926c-c3c016fa0bcf None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:35.996740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278ff2a-0930-42d8-926c-c3c016fa0bcf None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:35.998019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 39/76] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:36.003457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278ff2a-0930-42d8-926c-c3c016fa0bcf None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.023138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.040043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.041520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.089297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.109386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278ff2a-0930-42d8-926c-c3c016fa0bcf None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.142306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 38/77] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:36.143124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.144714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6498-0497-472c-a759-3c9dfdf6cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.145744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6498-0497-472c-a759-3c9dfdf6cf24 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.146034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6498-0497-472c-a759-3c9dfdf6cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.146341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6498-0497-472c-a759-3c9dfdf6cf24 None admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.147564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6498-0497-472c-a759-3c9dfdf6cf24 None admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.149048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6498-0497-472c-a759-3c9dfdf6cf24 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.150701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:35 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.151831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.152123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.152403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.168118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:36.169235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:36.233288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 41/79] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:36.246393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.246393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.255420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd45d3-b79b-4544-82b0-34e9d2d52bbe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.290162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.290856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.291145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.291428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.292175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:36.292486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.293863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.302317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 39/80] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.303103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.316941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.336226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a85cc-0dfe-4034-9cc4-97daf5cec26c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.370451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.371348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.371634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.371910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.382149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:36.390236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:36.391260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:36.392044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:36.392696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.406374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9097f23-5234-4b99-a138-824ed221e959 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.439397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.440196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.440485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.440767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.442040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.443605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.445394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.446162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.465712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.497432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb03ae3-d5af-428b-9cb0-e4e70453cd86 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.522746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.531003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.531659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.531952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.532235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.545045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810ce89-704f-43de-a8c4-dab38fca4729 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.577937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.578797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.579088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.579373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.580549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.582544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.584365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.585020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.601935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.603450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.668358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.684299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c58a-fe2b-499c-b420-7afc3fba8e64 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.699974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 43/84] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:36.700736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.717267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.718144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.718470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.718756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.719971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.721417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.723221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 42/85] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.723917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.739739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.798866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d87911-dbd8-473d-a0bd-cc2a3f325410 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.823442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa818fa-5904-477d-9f73-75294cd10b75 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.831366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.832028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.832311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.832586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.833328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:36.833636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.835025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.842798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 44/86] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.845324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.856315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:36.856967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:36.857253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:36.857531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:36.858388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=1b2070e8c1934cd2858f41274edb64eb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:36.858703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:36.860137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:36.878254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 43/87] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/role_assignments?user.id=1b2070e8c1934cd2858f41274edb64eb&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=f60d92c63c684ab6b89b982e4049558a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:36.878254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:36.891046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.954477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:36.970603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39f1c1-50c7-4ec5-9961-f5a88d8ce0bd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:36.979600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941bbfd-4ca3-4af2-9409-cb0c09485293 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.008174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.008867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.009157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.009458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.010173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.011665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.022001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.022915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.023208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.023513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.024709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.027029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.027968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:36 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:37.029482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:37.046385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 45/89] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:56:36 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:37.047531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:37.173736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:37.186711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f71352-d234-4348-8add-06ff8529d47e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.191385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dede12-493b-4db3-96d1-05df97740c43 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.234163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.234827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.235099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.235383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.245113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.246007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.246320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.246606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.248399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.249784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.251662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:37 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:37.256938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:37.257269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:37.328519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.330007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.406562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d50c4-1f11-40ef-9a3c-34db3af63dd2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.451064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.452025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.452321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.452605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.453930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=6a27e99cfbbf4208a8877f4098e73599) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:37.454334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.456770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.464200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:37 2022] GET /identity/v3/role_assignments?user.id=6a27e99cfbbf4208a8877f4098e73599&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:37.464918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:37.465813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 45/92] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:37.473700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:37.499278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:37.547548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:37.658470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465b20b-0637-43e1-879f-62a9f2fee135 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.660970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6aa25-f3e1-44fd-a5cc-418c83db2baf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.723500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.724517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.724810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.725095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] PATH_INFO: `/v3/projects/8e093661de5b4b70a575264f0bb4545f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.730156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=8e093661de5b4b70a575264f0bb4545f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.731694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.733804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:37 2022] GET /identity/v3/projects/8e093661de5b4b70a575264f0bb4545f => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:37.739497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:37.740166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:37.740262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:37.740712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:37.740998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:37.881775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:37.883907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:37.915992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c019-d0dc-48ff-ae02-bef72cc0a8a0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:37.920796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:37.947378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:38.000065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:38.000715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:38.001011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:38.001290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:38.002136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=8e093661de5b4b70a575264f0bb4545f, user.id=1b2070e8c1934cd2858f41274edb64eb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:38.002502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:38.004643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:38.011885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:38.016404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:37 2022] GET /identity/v3/role_assignments?user.id=1b2070e8c1934cd2858f41274edb64eb&scope.project.id=8e093661de5b4b70a575264f0bb4545f&role.id=f60d92c63c684ab6b89b982e4049558a => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:38.017515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:38.130728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916ee80-8ba2-4f3a-ab89-8db568be0fe8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:38.152303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:38.168311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf2a66-d7da-4921-9898-989b3bc7ff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:38.169544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf2a66-d7da-4921-9898-989b3bc7ff45 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:38.170051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf2a66-d7da-4921-9898-989b3bc7ff45 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:38.170771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf2a66-d7da-4921-9898-989b3bc7ff45 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:38.172181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf2a66-d7da-4921-9898-989b3bc7ff45 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:38.173864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf2a66-d7da-4921-9898-989b3bc7ff45 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:38.176345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:38 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:38.182447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:38.353073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2b0c5-96db-4cc2-979b-9a64b5a3aaaa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:38.394248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:38.395298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:38.395828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:38.396308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:38.397376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] RBAC: Adding query filter params (role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=1b2070e8c1934cd2858f41274edb64eb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:38.397891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:38.399540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e110e-de6d-4319-a970-0608ba7a4739 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:38.405563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:38 2022] GET /identity/v3/role_assignments?user.id=1b2070e8c1934cd2858f41274edb64eb&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:39.219357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2693-9123-4e66-af76-a4c392190f75 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:39.219870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2693-9123-4e66-af76-a4c392190f75 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:39.219950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2693-9123-4e66-af76-a4c392190f75 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:39.221486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:39.226843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:39.227225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:39.227421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:39.244954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:39.246152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:39.294925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:39.332834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:39.367404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2693-9123-4e66-af76-a4c392190f75 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:39.489981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2693-9123-4e66-af76-a4c392190f75 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:39.527049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:39.527855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:39.528149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:39.528435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:39.539727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:39.547741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:39.548588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:39.549371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 51/100] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:39.556407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:39.712566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afb66f-8a11-449a-aa14-8bba589e286f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:39.756881 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:39.757612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:39.757910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:39.758197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:39.758989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:39.759308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:39.760709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:39.775374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:39.785824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 50/101] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:39.843442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:39.909986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def529a-7975-4308-8acc-c48f60841a1f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:39.954646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:39.955639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:39.956430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:39.956716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:39.957953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:39.963560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:39.965433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:39 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:39.971042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:40.021999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:40.112987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e2962-de34-422a-af1a-64294aa7f52e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:40.148091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc405c2-15b3-45eb-991c-ed842164553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:40.148966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc405c2-15b3-45eb-991c-ed842164553f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.149252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc405c2-15b3-45eb-991c-ed842164553f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.149534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc405c2-15b3-45eb-991c-ed842164553f None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.150762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc405c2-15b3-45eb-991c-ed842164553f None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:40.152218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc405c2-15b3-45eb-991c-ed842164553f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:40.154114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 51/103] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:39 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:40.159698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:40.289114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91c718-3ef4-40c1-910e-fd35ea86a251 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:40.312437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:40.337889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd1744-f760-4820-bf43-1b5cb4219a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:40.338811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1744-f760-4820-bf43-1b5cb4219a42 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.339104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1744-f760-4820-bf43-1b5cb4219a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.339386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd1744-f760-4820-bf43-1b5cb4219a42 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/1b2070e8c1934cd2858f41274edb64eb/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.342813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1744-f760-4820-bf43-1b5cb4219a42 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0764a20fd3346b99be74625b068a5d4, user_id=1b2070e8c1934cd2858f41274edb64eb, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:40.344325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd1744-f760-4820-bf43-1b5cb4219a42 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:40.366758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 53/104] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:40 2022] PUT /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/1b2070e8c1934cd2858f41274edb64eb/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:40.464188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b196b-f96e-4942-92b8-f287464cf1c5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.464688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b196b-f96e-4942-92b8-f287464cf1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.464759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b196b-f96e-4942-92b8-f287464cf1c5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.466265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 52/105] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:40.472954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1b93-58ec-456a-8748-6830672c68e4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.473267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1b93-58ec-456a-8748-6830672c68e4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.473612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f1b93-58ec-456a-8748-6830672c68e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.497284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ac0f1b93-58ec-456a-8748-6830672c68e4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:40.498648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ac0f1b93-58ec-456a-8748-6830672c68e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:40.508401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6884c-40cb-4ae0-896c-b3fbc6ead4d3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.508728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6884c-40cb-4ae0-896c-b3fbc6ead4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.508966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6884c-40cb-4ae0-896c-b3fbc6ead4d3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.510482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 53/106] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:40.516726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.517001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.517284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.541540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:40.542802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:40.631762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 54/107] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:40.633527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3444ec1-f413-4dbb-8325-b9a852a61fd2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.634530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3444ec1-f413-4dbb-8325-b9a852a61fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.634960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3444ec1-f413-4dbb-8325-b9a852a61fd2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.636921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 55/108] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:40.642961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.644149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.644574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.652681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 54/109] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:40.663455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:40.664830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:40.674164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:40.715199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:40.744030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 56/110] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:40.744905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:40.798654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:40.809743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a839f06-b71a-4821-b384-5a69d2761c23 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:40.846731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:40.847536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.847827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.848099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.858679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:40.867821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:40.868689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:40.869439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:40.870037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1727f-1dc5-4a82-a254-0f6d958d3fd3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:40.870106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 55/111] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:40.870106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:40.920076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:40.921272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:40.921571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:40.922129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:40.923611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:40.926040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:40.928421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:40.929307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.010922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:41.025257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7115540-c426-4f09-b460-56765bd1f951 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.095100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.095908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.096760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.097050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.120564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:41.129020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ceae-0ee1-416b-9e5f-f2f563187918 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.131486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:41.131670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:41.133893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:41.135858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.184787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.185384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.185670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.185955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.186815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:41.187127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:41.188577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:41.197431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 58/114] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:41.198254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.307090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8f51e-d690-4b84-bdea-67cbb55f58cb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.342732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.343576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.343868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.344150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.345303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:41.345621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:41.347332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:41.358527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 59/115] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:41.363219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.379123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1be86-b83a-4e49-a7f4-19415ceff604 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.394597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:41.428949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.430066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.430707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.431207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.432225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:41.433977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:41.463394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 57/116] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:56:41 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:41.464706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.481591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca938e5-0711-4fe6-9a12-b136fb43cfb0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.490894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:41.520113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cbab1-67e7-4899-b8bf-65f94f6194e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.521062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbab1-67e7-4899-b8bf-65f94f6194e8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.521299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbab1-67e7-4899-b8bf-65f94f6194e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.521609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbab1-67e7-4899-b8bf-65f94f6194e8 None admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.531183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbab1-67e7-4899-b8bf-65f94f6194e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:41.532817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbab1-67e7-4899-b8bf-65f94f6194e8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:41.536038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 60/117] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:41 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:41.539069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610fcd-afd7-4b83-b381-b08f0236067b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.539363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610fcd-afd7-4b83-b381-b08f0236067b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.546741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78610fcd-afd7-4b83-b381-b08f0236067b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.548328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 61/118] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:41.549296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78610fcd-afd7-4b83-b381-b08f0236067b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.599281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2e6d2-daed-45d8-a4fc-62a55763d9e2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.644625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7560f5-59ea-4400-8daf-7d473d67fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.646083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7560f5-59ea-4400-8daf-7d473d67fbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.646617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7560f5-59ea-4400-8daf-7d473d67fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.647092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7560f5-59ea-4400-8daf-7d473d67fbe3 None admin] PATH_INFO: `/v3/users/0c40285f59fd49ec854ce79e42cb9dc7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.664292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7560f5-59ea-4400-8daf-7d473d67fbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=0c40285f59fd49ec854ce79e42cb9dc7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:41.666271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7560f5-59ea-4400-8daf-7d473d67fbe3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:41.668353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 58/119] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:41 2022] GET /identity/v3/users/0c40285f59fd49ec854ce79e42cb9dc7 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:41.669911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64b8a5-8c47-4668-b849-6f6c20be2d82 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.670442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64b8a5-8c47-4668-b849-6f6c20be2d82 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.671138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64b8a5-8c47-4668-b849-6f6c20be2d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.689562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ce64b8a5-8c47-4668-b849-6f6c20be2d82 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:41.691261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ce64b8a5-8c47-4668-b849-6f6c20be2d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:41.697318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:41.704861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78610fcd-afd7-4b83-b381-b08f0236067b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.752577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60d4a-b0e2-459a-999c-81625ed392d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.753422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60d4a-b0e2-459a-999c-81625ed392d5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.753752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60d4a-b0e2-459a-999c-81625ed392d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.754133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60d4a-b0e2-459a-999c-81625ed392d5 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.756289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60d4a-b0e2-459a-999c-81625ed392d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:41.757792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60d4a-b0e2-459a-999c-81625ed392d5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:41.759868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 62/120] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:41 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:41.761091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b090-ab82-459e-a6ec-e59e4104b31c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.761453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b090-ab82-459e-a6ec-e59e4104b31c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.761731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b090-ab82-459e-a6ec-e59e4104b31c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.765358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:41.767217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 63/121] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:41.768595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b090-ab82-459e-a6ec-e59e4104b31c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.779735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 59/122] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:41.781433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.781947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.782489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:41.800461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:41.802146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:41.892108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 60/123] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:41.893434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:41.904382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b090-ab82-459e-a6ec-e59e4104b31c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:41.966781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:41.967476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:41.967765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:41.968072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.002200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.017492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e07472-a14e-40a6-8ad4-c822825c2b4d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.042419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.047039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.050155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.055497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.056577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.056966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.057346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/6a27e99cfbbf4208a8877f4098e73599/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.059510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] RBAC: Authorizing `identity:create_grant(project_id=e0764a20fd3346b99be74625b068a5d4, user_id=6a27e99cfbbf4208a8877f4098e73599, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.061065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.076456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 61/124] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:41 2022] PUT /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/6a27e99cfbbf4208a8877f4098e73599/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:42.077837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.163382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 64/125] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:42.164195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.196825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3271a-2078-4d16-992a-affd5454b5af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.233694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.237707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.239540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.240085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.240844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.253883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:42.262633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:42.263563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:42.264305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:42.267008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:42.273513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.276760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c720c1-799d-466a-b7da-4835f4de9a1f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.314485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.315867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.316157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.316439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.324705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.329734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:42.340396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:42.341408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:42.342213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:42.342888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.393074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed686775-3f09-4bef-9bb6-e84c26e79c59 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.429370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.430631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.431122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.431618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.433032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.434764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.436691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:42.437649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.477517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613cada-6f62-4cb7-8c25-b9aa35158409 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.514635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.520010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.521091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.521485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.522114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.522990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:42.523377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.525355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.535446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 66/129] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:42.536439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.550256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4b2eb-f7fe-4e4f-ad19-2b8073ae7386 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.564737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.587227 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.588002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.588364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.588712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.589544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:42.589924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.591385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.599895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 64/130] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:42.600788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.704689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5d6c0-8ba4-4203-9d5d-cb7af7f4e22f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.741119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.742150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.742523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.742868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.744319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.745864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.747753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:42.748583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.798685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:42.861351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad714-f77c-43b6-8194-776e1c72fdba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.868679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f112486-efb0-4c84-99ab-84fad8dca9d2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:42.898690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.899642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.900126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.900575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.901592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] RBAC: Adding query filter params (role.id=bd66dea4a80644bdb90f1f0208ea11de, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=0c40285f59fd49ec854ce79e42cb9dc7) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:42.902080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.903705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.910528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 67/132] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/role_assignments?user.id=0c40285f59fd49ec854ce79e42cb9dc7&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=bd66dea4a80644bdb90f1f0208ea11de => generated 259 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:42.911542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:42.913395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974883-09d0-4037-8033-243f28a8371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:42.914425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974883-09d0-4037-8033-243f28a8371e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.915102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974883-09d0-4037-8033-243f28a8371e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.915454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974883-09d0-4037-8033-243f28a8371e None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.918030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974883-09d0-4037-8033-243f28a8371e None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:42.919642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974883-09d0-4037-8033-243f28a8371e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:42.921820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 66/133] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:42.924016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afac14-90fa-4a47-8b4f-adafac312dc1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:42.924945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afac14-90fa-4a47-8b4f-adafac312dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:42.925295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afac14-90fa-4a47-8b4f-adafac312dc1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:42.927395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 67/134] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:42.931808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afac14-90fa-4a47-8b4f-adafac312dc1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:43.054949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:43.058868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afac14-90fa-4a47-8b4f-adafac312dc1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.071769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:43.102243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78948694-084e-4611-8c1b-e16db704621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.103549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78948694-084e-4611-8c1b-e16db704621b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.103840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78948694-084e-4611-8c1b-e16db704621b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.104120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78948694-084e-4611-8c1b-e16db704621b None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.105646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78948694-084e-4611-8c1b-e16db704621b None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:43.107171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78948694-084e-4611-8c1b-e16db704621b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:43.109103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 68/135] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:43.110750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.111074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.111360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.132055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:43.133389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:43.164815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c9642-0ba7-475a-aa95-2739d3a5f411 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.218034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.218928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:43.219035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.219222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.219589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] PATH_INFO: `/v3/projects/8e093661de5b4b70a575264f0bb4545f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.219708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:43.220782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e093661de5b4b70a575264f0bb4545f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:43.222314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:43.224262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 68/137] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:42 2022] GET /identity/v3/projects/8e093661de5b4b70a575264f0bb4545f => generated 312 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:43.235083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:43.335355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dcac-c9ab-46ab-89fd-25b57b5ba210 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.344332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:43.376014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.376919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.377205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.378036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/1b2070e8c1934cd2858f41274edb64eb/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.380457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] RBAC: Authorizing `identity:create_grant(project_id=e0764a20fd3346b99be74625b068a5d4, user_id=1b2070e8c1934cd2858f41274edb64eb, role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:43.381912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:43.398272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 70/138] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:43 2022] PUT /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/1b2070e8c1934cd2858f41274edb64eb/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:43.399158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:43.516699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d6f2a-1f50-4cf0-ba74-502ac0da1e6c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.527152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2ed54-a344-4476-8040-10c70f8545d5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.557432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.558289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.558816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.559170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.559778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:43.576290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:43.585343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:43.587652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:43.589376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 71/139] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:43.594312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.594312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.594312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.594312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] PATH_INFO: `/v3/projects/8e093661de5b4b70a575264f0bb4545f/users/1b2070e8c1934cd2858f41274edb64eb/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.596611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:43.604939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e093661de5b4b70a575264f0bb4545f, user_id=1b2070e8c1934cd2858f41274edb64eb, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:43.606471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:43.634159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 69/140] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:43 2022] PUT /identity/v3/projects/8e093661de5b4b70a575264f0bb4545f/users/1b2070e8c1934cd2858f41274edb64eb/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:43.653653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:43.760220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f3ae6-487a-4f2e-ae56-afdf6fd0efbe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.804418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.805119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.805405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.805683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:43.806483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:43.806798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:43.808214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:43.822639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 72/141] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:43.828405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:43.955112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab88c3-e560-44f7-bded-bd8ece9660f9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:43.997532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:43.998437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:43.998723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:43.999004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.000216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:44.001691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:44.003671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 70/142] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:43 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:44.010551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:44.110638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:44.116619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e6b59-c1ca-4879-9130-f0a4e897e13b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:44.152203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:44.152918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.153203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.153527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.223310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:44.224694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:44.327206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:44.331135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 73/143] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:44.333443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:44.398527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:44.470038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ae4a1-1e3d-4b01-9d9b-8e20e273fd10 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:44.516131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b6c54-34ed-45c6-806c-8ae23a4588b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:44.516912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b6c54-34ed-45c6-806c-8ae23a4588b6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.517195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b6c54-34ed-45c6-806c-8ae23a4588b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.517470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b6c54-34ed-45c6-806c-8ae23a4588b6 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.522961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b6c54-34ed-45c6-806c-8ae23a4588b6 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:44.524422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b6c54-34ed-45c6-806c-8ae23a4588b6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:44.526128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:44 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:44.532156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:44.612440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4286a-3b4d-4484-8466-f4b1a33a05f4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.612959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4286a-3b4d-4484-8466-f4b1a33a05f4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.613032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4286a-3b4d-4484-8466-f4b1a33a05f4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.614522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 72/145] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:44.623452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.623742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.624022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.652071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:44.653272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:44.726049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfde43-36f9-4c83-a17f-92cfca214b53 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:44.758745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 73/146] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:44.805186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:44.815502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:44.816180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.816464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.816745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.817598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=1b2070e8c1934cd2858f41274edb64eb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:44.817919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:44.819396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ab8d1-2d8d-455c-8030-8b5f6d5d9ce9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:44.826518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 74/147] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:44 2022] GET /identity/v3/role_assignments?user.id=1b2070e8c1934cd2858f41274edb64eb&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=f60d92c63c684ab6b89b982e4049558a => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:44.827776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c517fc0-60c5-47bd-8f80-21ea2fd558c7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.828072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c517fc0-60c5-47bd-8f80-21ea2fd558c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.828348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c517fc0-60c5-47bd-8f80-21ea2fd558c7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.829594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 75/148] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:44.835320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:44.835616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:44.835886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:44.856258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:44.857745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:44.890674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:44.931706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:44.977685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 76/149] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:45.012631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002a6e-0271-4d4f-bf52-5c0c7400f18c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:45.019414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:45.082547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:45.083773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.084270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.084749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.087309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:45.089088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:45.091283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 74/150] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:45.097655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:45.174182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14be1a-a79b-44a8-a3b1-ea28cd013ed7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:45.242449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:45.243622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.244191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.245780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.267293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:45.278951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:45.279869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:45.280662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:45.284084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 77/151] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:45.291920 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:45.296982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d5254-436d-4b39-9466-745ffb5e562a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:45.316894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:45.358520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:45.359205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.359488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.359760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.360481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:45.362485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:45.375908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:45.398341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 75/152] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:56:45 2022] POST /identity/v3/users => generated 283 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:45.460545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940444-19e1-483e-b385-f31eab9d1955 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:45.517552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:45.518315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.518601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.518877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.519648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:45.519960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:45.521360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:45.534547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 78/153] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:45.540250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:45.652819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee9b8d-f8d1-4dc8-aab5-97b00ab240a4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:45.691045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a3c7-c5ca-42c3-9c40-a5719fcc5914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:45.691979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a3c7-c5ca-42c3-9c40-a5719fcc5914 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.692271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a3c7-c5ca-42c3-9c40-a5719fcc5914 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.692550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a3c7-c5ca-42c3-9c40-a5719fcc5914 None admin] PATH_INFO: `/v3/users/6a27e99cfbbf4208a8877f4098e73599` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.693764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a3c7-c5ca-42c3-9c40-a5719fcc5914 None admin] RBAC: Authorizing `identity:get_user(user_id=6a27e99cfbbf4208a8877f4098e73599)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:45.695278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a3c7-c5ca-42c3-9c40-a5719fcc5914 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:45.697079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 76/154] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:45 2022] GET /identity/v3/users/6a27e99cfbbf4208a8877f4098e73599 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:45.702485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:45.836421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43f6df-953b-4acc-ae9c-a18c924fa819 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:45.838853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:45.876962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:45.878158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.878480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.878761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.958425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:45.959813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:45.981133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a21f5-9ec3-4dd3-a2f9-80cda81464d0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.981443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a21f5-9ec3-4dd3-a2f9-80cda81464d0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.981705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a21f5-9ec3-4dd3-a2f9-80cda81464d0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:45.983259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 77/155] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:56:45.989830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:45.990117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:45.990684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.026888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:46.028001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:46.064234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:46.098102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:46.104820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:46.111594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:46.131624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:46.158557 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:46.304900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1ac8c-a893-498f-952a-eb29fa152e02 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:46.348499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad75e27-893c-44e8-8374-8cc2fe4bc21f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:46.360651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc56806-a608-4df9-8a8c-ec93eec44a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:46.362251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56806-a608-4df9-8a8c-ec93eec44a18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.362507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56806-a608-4df9-8a8c-ec93eec44a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.362782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56806-a608-4df9-8a8c-ec93eec44a18 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.364298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc56806-a608-4df9-8a8c-ec93eec44a18 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:46.367656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc56806-a608-4df9-8a8c-ec93eec44a18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:46.367656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:46.369424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b766df-2d74-4dde-a158-b9500c3eef04 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.369713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b766df-2d74-4dde-a158-b9500c3eef04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.369993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b766df-2d74-4dde-a158-b9500c3eef04 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.371592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 81/159] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:46.376515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b766df-2d74-4dde-a158-b9500c3eef04 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:46.398128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06071b4d-548d-4c73-9142-15c5c59b1cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:46.399334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06071b4d-548d-4c73-9142-15c5c59b1cff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.399829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06071b4d-548d-4c73-9142-15c5c59b1cff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.400322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06071b4d-548d-4c73-9142-15c5c59b1cff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.414962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06071b4d-548d-4c73-9142-15c5c59b1cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-06071b4d-548d-4c73-9142-15c5c59b1cff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:46.425088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:46.425991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:46.426813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:46.429193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 79/160] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:46.434876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.435412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.435887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.454291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:46.456331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:46.468220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:46.478809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:46.503099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b766df-2d74-4dde-a158-b9500c3eef04 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:46.549667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:46.550535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:46.553723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:46.555710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.556263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.556706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.557770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=6a27e99cfbbf4208a8877f4098e73599) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:46.558251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:46.560502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:46.572608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 82/162] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/role_assignments?user.id=6a27e99cfbbf4208a8877f4098e73599&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:46.587705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:46.725940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb806bf-7baf-4628-b58b-67b6a9ffcadb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:46.779402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:46.780739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.781045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.781325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.782427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:46.782742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:46.785545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2769e73-f9b0-4bf0-ac73-76b843197f1b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:46.789168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a0eeb-f860-41b3-9858-c8aedaaa1ad5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:46.801520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 81/163] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:46.803462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01ef5-953e-4c0e-8e02-09609fd827e1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.803963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01ef5-953e-4c0e-8e02-09609fd827e1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.804460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01ef5-953e-4c0e-8e02-09609fd827e1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.806000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 82/164] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:46.807211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01ef5-953e-4c0e-8e02-09609fd827e1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:46.831457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71a48e-c176-4ed5-9267-3daed767471b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:46.831818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:46.832261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71a48e-c176-4ed5-9267-3daed767471b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.832827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71a48e-c176-4ed5-9267-3daed767471b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.832827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71a48e-c176-4ed5-9267-3daed767471b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.839077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:46.851845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71a48e-c176-4ed5-9267-3daed767471b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ac71a48e-c176-4ed5-9267-3daed767471b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:46.859864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:46.860746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 83/165] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:46.865759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:46.866783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:46.866783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:46.882494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:46.883700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:46.962246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01ef5-953e-4c0e-8e02-09609fd827e1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:46.972056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:46.973009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.029432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.030343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.031024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.031024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] PATH_INFO: `/v3/users/0c40285f59fd49ec854ce79e42cb9dc7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.034243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=0c40285f59fd49ec854ce79e42cb9dc7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:47.034836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:47.036499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 83/167] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/users/0c40285f59fd49ec854ce79e42cb9dc7 => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:47.041551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.152624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03110a-6332-40c4-a501-dd95af1cd3b5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.198716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.199447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.218704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.219382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.219663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.219939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.220700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:47.221571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:47.222998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:47.229305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd08759-7113-4b1f-87ae-e1415f851ba3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.234352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 85/168] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:47.234352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.296935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.298126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.301237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.301752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.322390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:47.332627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:47.333587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:47.334391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:47.341748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 84/169] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:56:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:47.343797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.427277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ed0e9-21f2-41a2-8c95-b5900d41f481 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.488592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.489830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.490345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.491118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.494726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:47.496762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:47.499873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 86/170] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:47 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:47.501021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.539571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671812ef-66e9-4362-bec3-58f4e900c86e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.601247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.607366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.608511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.609673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.610182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.611643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:47.613318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:47.615340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 85/171] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:47 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:47.616539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.649288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.666161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e17019-0833-4f15-b849-196ee435a605 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.705159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.705948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.706256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.706620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.707383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:47.707697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:47.709451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:47.718278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 87/172] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:56:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:47.718973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.814645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06df2e-a3a7-4dca-89b7-11d901ab2ad6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.876922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.878258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.878742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.879982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/0c40285f59fd49ec854ce79e42cb9dc7/roles/bd66dea4a80644bdb90f1f0208ea11de` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:47.883068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0764a20fd3346b99be74625b068a5d4, user_id=0c40285f59fd49ec854ce79e42cb9dc7, role_id=bd66dea4a80644bdb90f1f0208ea11de)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:47.886678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:47.895688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b4c84-d483-42ca-bd65-5fb5fc1bde4f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:47.911909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 86/173] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:47 2022] PUT /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4/users/0c40285f59fd49ec854ce79e42cb9dc7/roles/bd66dea4a80644bdb90f1f0208ea11de => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:47.913051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:47.935461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:47.969480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:47.970921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:47.971998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:47.972279 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.071585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.121166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14503306-e366-426e-9847-a4dfd18c0099 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:48.128351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:48.129863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:48.167382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:48.168631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.169170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.169744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] PATH_INFO: `/v3/users/1b2070e8c1934cd2858f41274edb64eb` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.171216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] RBAC: Authorizing `identity:get_user(user_id=1b2070e8c1934cd2858f41274edb64eb)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:48.172961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:48.175010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 87/174] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:47 2022] GET /identity/v3/users/1b2070e8c1934cd2858f41274edb64eb => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:48.180617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:48.252879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 88/175] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:48.258380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:48.282755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.314597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de51ea-c6bb-469b-88be-1af93a4e7538 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:48.351707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76dcb7-00ae-4d11-b0f6-9ef12f81d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:48.352722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76dcb7-00ae-4d11-b0f6-9ef12f81d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.353233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76dcb7-00ae-4d11-b0f6-9ef12f81d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.353733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76dcb7-00ae-4d11-b0f6-9ef12f81d7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.366970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.405592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1d4ea-6834-43c8-9ea2-620bb16584aa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:48.445317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76dcb7-00ae-4d11-b0f6-9ef12f81d7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:48.447337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76dcb7-00ae-4d11-b0f6-9ef12f81d7a2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:48.449767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4bef4-0735-4e2e-a629-e15eed9a13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:48.451174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bef4-0735-4e2e-a629-e15eed9a13f5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.451174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bef4-0735-4e2e-a629-e15eed9a13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.451378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bef4-0735-4e2e-a629-e15eed9a13f5 None admin] PATH_INFO: `/v3/projects/8e093661de5b4b70a575264f0bb4545f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.452582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4bef4-0735-4e2e-a629-e15eed9a13f5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e093661de5b4b70a575264f0bb4545f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:48.454099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4bef4-0735-4e2e-a629-e15eed9a13f5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:48.456162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 89/176] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/projects/8e093661de5b4b70a575264f0bb4545f => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:48.461947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a3c5-8295-4910-b12e-6e6e3d84fe12 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.462209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a3c5-8295-4910-b12e-6e6e3d84fe12 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.462612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a3c5-8295-4910-b12e-6e6e3d84fe12 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.463945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 90/177] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:48.468702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a3c5-8295-4910-b12e-6e6e3d84fe12 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:48.576020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 88/178] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:48.577987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.578523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.579271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.581838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.600399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:48.602320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:48.616764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a3c5-8295-4910-b12e-6e6e3d84fe12 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:48.661244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.669179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:48.670185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.670698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.671177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.672244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=8e093661de5b4b70a575264f0bb4545f, user.id=1b2070e8c1934cd2858f41274edb64eb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:48.672778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:48.675001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:48.686068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 91/179] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/role_assignments?user.id=1b2070e8c1934cd2858f41274edb64eb&scope.project.id=8e093661de5b4b70a575264f0bb4545f&role.id=f60d92c63c684ab6b89b982e4049558a => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:48.686923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:48.708727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 89/180] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:48.761718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:48.844617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af01af0-3ab0-4e85-ba60-7c453f28a393 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:48.875671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe03af0-a032-4cbf-877a-af06e802b01a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:48.912064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:48.912973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.913234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.913509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.914875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:48.916215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:48.916422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:48.917536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:48.918331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 92/181] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:48.918597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:48.919177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:48.924330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:48.932063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:48.948158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:48.949131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:48.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:48.952893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 90/182] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:48.953374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.960174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.039687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:49.116958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935aa36f-f36d-4390-aeba-9cc90e290444 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:49.120318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc229a1-822e-4bdf-9aa3-8cf74e3f8194 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:49.158763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:49.159440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.159732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.160008 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.160763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:49.161188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:49.162607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:49.171712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 91/183] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:49.177758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.186922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:49.187710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.188003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.188283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.189131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] RBAC: Adding query filter params (role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=1b2070e8c1934cd2858f41274edb64eb) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:49.189446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:49.191617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:49.199204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 93/184] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:48 2022] GET /identity/v3/role_assignments?user.id=1b2070e8c1934cd2858f41274edb64eb&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:49.282604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:49.290090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eea48-b3d6-47d2-afc9-56089330d6c9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:49.328221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853495-87e6-4f0b-bed5-e278c5fb6518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:49.329125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853495-87e6-4f0b-bed5-e278c5fb6518 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.329478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853495-87e6-4f0b-bed5-e278c5fb6518 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.329767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853495-87e6-4f0b-bed5-e278c5fb6518 None admin] PATH_INFO: `/v3/users/ad700b628a6446b2a68917c406942540` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.344948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853495-87e6-4f0b-bed5-e278c5fb6518 None admin] RBAC: Authorizing `identity:get_user(user_id=ad700b628a6446b2a68917c406942540)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:49.346498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853495-87e6-4f0b-bed5-e278c5fb6518 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:49.348632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 92/185] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:49 2022] GET /identity/v3/users/ad700b628a6446b2a68917c406942540 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:49.354370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.449982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:49.474453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec384-5b86-417a-bf78-03dc7ec2a83c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:49.497921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dfed-9ce6-4c7b-a35e-c29846ca010a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.498265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dfed-9ce6-4c7b-a35e-c29846ca010a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.499412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9dfed-9ce6-4c7b-a35e-c29846ca010a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.501618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 93/186] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:49.510671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76ae1-1e06-4e0e-9fd2-c08f94c1ab03 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.511126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76ae1-1e06-4e0e-9fd2-c08f94c1ab03 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.511630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b76ae1-1e06-4e0e-9fd2-c08f94c1ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.525169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:49.526056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.526524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.526936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.531580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d1b76ae1-1e06-4e0e-9fd2-c08f94c1ab03 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:49.532843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d1b76ae1-1e06-4e0e-9fd2-c08f94c1ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:49.609525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:49.612133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:49.617472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 94/187] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:49.629531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d96a0e-bb3e-4dc2-aa9a-9e693ac90db6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.629824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d96a0e-bb3e-4dc2-aa9a-9e693ac90db6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.630123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d96a0e-bb3e-4dc2-aa9a-9e693ac90db6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.631497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 95/188] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:56:49.637066 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.637353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.637632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.655808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:49.656646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:49.709322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:49.729856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 94/189] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:49.730601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.734369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 96/190] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:49.737513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.759436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:49.852470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af53a8b-f72b-48e6-a709-44a350a6405c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:49.856112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569bcd-a12e-41a2-a7fc-7d8b2ea7f613 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:49.888113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:49.888921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.889503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.889786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.891104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:49.892603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:49.894752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:49.895509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.895998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:49.897322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:49.897746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:49.898153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:49.899390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:49.900823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:49.902790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 97/192] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:49 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:49.903531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:49.952861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:49.987537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.010368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b980-491a-4a80-93ba-4daca98f0d80 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.010665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acda7cc-ceed-45a3-bcfa-d21443a8badc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.049469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.050017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.050203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.050511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.050811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.051102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.051476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.051563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:50.051826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.052937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:50.062936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:50.071774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:50.072958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:50.073987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:50.074638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 98/193] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:56:49 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:50.074638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.082933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:56:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:50.090084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.198608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ee2f4-75bd-4850-98dd-a7113d91f0e5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.235474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c8046-2123-4cd0-ac61-2e6211137409 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.246873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.247808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.248268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.248715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.249660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.249785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=ad700b628a6446b2a68917c406942540) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:50.250037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:50.251519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:50.255899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.260204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 99/195] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/role_assignments?user.id=ad700b628a6446b2a68917c406942540&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:50.277979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.277979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.277979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.278397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.280532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:50.280532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:50.281706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d645bba-75dc-4e39-a691-a9c0a54ba268 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:50.294710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 97/196] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:50.301127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.421811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17903371-12df-4a9e-9502-c9d82749d012 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.462269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.463156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.463445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.463723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] PATH_INFO: `/v3/users/ad700b628a6446b2a68917c406942540` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.464960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] RBAC: Authorizing `identity:get_user(user_id=ad700b628a6446b2a68917c406942540)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:50.466522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:50.468505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 100/197] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/users/ad700b628a6446b2a68917c406942540 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:50.473873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.474515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b058-7c54-429a-a529-55278e1960c7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.475013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b058-7c54-429a-a529-55278e1960c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.475488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b058-7c54-429a-a529-55278e1960c7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.477357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 98/198] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:50.483000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.483545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.484000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.504813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:50.506323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:50.554644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.581821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 99/199] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:50.591389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af07d-f393-4519-ae1e-395d2cc23523 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.607433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.629164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.629822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.630101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.630490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.716066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad78222-aab2-486d-a3c8-592e87bf469e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.716384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:50.717785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:50.718360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.758760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.760848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.761354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.761859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.776123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:50.787394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:50.788301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:50.789092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:50.792086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 100/200] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:50.797736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.798590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.836297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 101/201] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:50.845441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:50.906657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b50309-ee28-48e1-ab9c-85717515c9c9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:50.944474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:50.945175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:50.945457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:50.945731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:50.946791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:50.947102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:50.948470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:50.958641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 101/202] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:50.967232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:51.014288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:51.052216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fd6e5-7dd8-4739-8d6c-884f1dd68b61 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:51.114211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:51.115155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:51.115703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:51.116155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:51.118175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:51.119660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:51.121362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 102/203] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:51.128436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:51.153130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edc3ef-4410-4e78-aa1e-8942b739eca4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:51.190590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:51.224070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:51.224954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:51.225237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:51.225514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] PATH_INFO: `/v3/users/0c40285f59fd49ec854ce79e42cb9dc7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:51.227916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] RBAC: Authorizing `identity:get_user(user_id=0c40285f59fd49ec854ce79e42cb9dc7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:51.229361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:51.233190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 102/204] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:50 2022] GET /identity/v3/users/0c40285f59fd49ec854ce79e42cb9dc7 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:51.242256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:51.322544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6877b8e-35a9-4d10-a714-c82fc3584b2a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:51.370881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:51.371579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:51.371862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:51.372135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:51.373218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] RBAC: Adding query filter params (role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=ad700b628a6446b2a68917c406942540) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:51.373525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:51.375000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:51.381339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 103/205] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:51 2022] GET /identity/v3/role_assignments?user.id=ad700b628a6446b2a68917c406942540&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:51.454442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:51.467951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3519-f925-4a09-94c6-fab2ee8963e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:51.520377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:51.521054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:51.521331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:51.521607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:51.609883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:51.611368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:51.712051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:51.722497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 103/206] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:51.728080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:51.855883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:51.866665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b17cf0-8744-4af3-88a6-a7eef794f1f0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:51.912326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b14b7-81e5-4ca1-a9d4-f662bf4592c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:51.913244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b14b7-81e5-4ca1-a9d4-f662bf4592c3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:51.913525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b14b7-81e5-4ca1-a9d4-f662bf4592c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:51.913795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b14b7-81e5-4ca1-a9d4-f662bf4592c3 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:51.915082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b14b7-81e5-4ca1-a9d4-f662bf4592c3 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:51.916527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b14b7-81e5-4ca1-a9d4-f662bf4592c3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:51.918549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 104/207] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:51 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:51.924886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:52.053751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ba1b2-5b8a-48d5-82d2-7929152cb763 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:52.104114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:52.104772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:52.105050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:52.105323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:52.106161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] RBAC: Adding query filter params (role.id=bd66dea4a80644bdb90f1f0208ea11de, scope.project.id=e0764a20fd3346b99be74625b068a5d4, user.id=0c40285f59fd49ec854ce79e42cb9dc7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:52.106497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:52.107924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffc60f-72c2-41f7-a4b0-4d82e267ed3e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:52.114250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 104/208] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:51 2022] GET /identity/v3/role_assignments?user.id=0c40285f59fd49ec854ce79e42cb9dc7&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=bd66dea4a80644bdb90f1f0208ea11de => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:52.678269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f525e-7e3b-41ac-93fd-eb163a1b8740 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:52.678772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f525e-7e3b-41ac-93fd-eb163a1b8740 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:52.678873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f525e-7e3b-41ac-93fd-eb163a1b8740 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:52.680186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 105/209] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:52.685511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:52.686038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:52.686530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:52.709335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:52.710894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:52.760475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f492daa-ca24-4ad3-9ad9-f95dc0dca8e4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:52.761085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f492daa-ca24-4ad3-9ad9-f95dc0dca8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:52.761555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f492daa-ca24-4ad3-9ad9-f95dc0dca8e4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:52.763652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 106/210] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:52.775232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:52.783490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:52.784207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:52.784777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:52.796940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:52.805730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:52.807290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:52.820389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:52.894244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:52.910148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:52.951032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de834d86-a91d-4732-9fe1-a4150d088d27 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:52.992620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493e5cd-276f-4f8c-bd3d-6769f9f6bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:52.994326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493e5cd-276f-4f8c-bd3d-6769f9f6bfbb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:52.994620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493e5cd-276f-4f8c-bd3d-6769f9f6bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:52.994899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493e5cd-276f-4f8c-bd3d-6769f9f6bfbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.008005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493e5cd-276f-4f8c-bd3d-6769f9f6bfbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6493e5cd-276f-4f8c-bd3d-6769f9f6bfbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:53.018845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:53.020537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:53.023429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.026023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45231d-ef43-44c4-9bca-8462a5b512e5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.026493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45231d-ef43-44c4-9bca-8462a5b512e5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.026931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45231d-ef43-44c4-9bca-8462a5b512e5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.027785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1356f0e-db95-4583-b0fa-e94766d060b3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.030428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 107/214] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:53.031512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45231d-ef43-44c4-9bca-8462a5b512e5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.064419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb7f5e-3630-4a2a-aa51-d3c278cb7769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.065266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7f5e-3630-4a2a-aa51-d3c278cb7769 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.065546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7f5e-3630-4a2a-aa51-d3c278cb7769 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.065819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb7f5e-3630-4a2a-aa51-d3c278cb7769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.077455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb7f5e-3630-4a2a-aa51-d3c278cb7769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:53.082068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-48fb7f5e-3630-4a2a-aa51-d3c278cb7769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:53.088908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:53.089803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:53.090623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:53.094356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:53.095603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.096597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.096878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.112999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:53.114160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:53.148016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45231d-ef43-44c4-9bca-8462a5b512e5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.183292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.184319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.184804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.185002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 109/216] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:53.185469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.185792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.186741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:53.187250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.188849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.203290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 108/217] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:53.211709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.284634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.298400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca03bd-e241-4e1f-a1f4-e08d1bdcd3c4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.321454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93373be-2173-4ae8-bbca-9de20fbbb0b0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.333745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.334438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.334720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.334857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.334990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.335740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:53.336045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.337432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.346685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 110/218] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:53.347306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.369779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.370682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.370963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.371234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] PATH_INFO: `/v3/users/ad700b628a6446b2a68917c406942540` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.372411 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] RBAC: Authorizing `identity:get_user(user_id=ad700b628a6446b2a68917c406942540)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.373891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.375650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 109/219] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/users/ad700b628a6446b2a68917c406942540 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:53.376251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.460924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306076-bd50-496f-a951-0d4e068e8009 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.476178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eaf72-104b-465e-8c47-24080962d90f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.496682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.497488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.497776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.498052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.499372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.500945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.507099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 111/220] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:53.507099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.514599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.515475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.515754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.516027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] PATH_INFO: `/v3/users/1cda5e6489cf4fcd99c8707649fa77e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.524386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.530307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] RBAC: Authorizing `identity:get_user(user_id=1cda5e6489cf4fcd99c8707649fa77e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.531767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.534027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 110/221] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/users/1cda5e6489cf4fcd99c8707649fa77e1 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:53.534027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.570090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.623144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac1170-7496-4796-b962-284aeaf9a5eb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.636174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a69bd-8d17-4257-88e2-c6e7c44d1f26 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.660471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.661348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.661634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.661911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.663135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.664594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.670901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 112/222] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:53.670901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.671109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8832437-bc60-45b5-aa9e-933d7bd2f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.671199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8832437-bc60-45b5-aa9e-933d7bd2f75f None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.671485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8832437-bc60-45b5-aa9e-933d7bd2f75f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.671760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8832437-bc60-45b5-aa9e-933d7bd2f75f None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.672462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8832437-bc60-45b5-aa9e-933d7bd2f75f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.674439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8832437-bc60-45b5-aa9e-933d7bd2f75f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.693986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 111/223] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:56:53 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:53.695274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4855c6-3ebf-4a10-86b6-535f7e7f5ca6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.695558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4855c6-3ebf-4a10-86b6-535f7e7f5ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.695829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4855c6-3ebf-4a10-86b6-535f7e7f5ca6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.697094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 112/224] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:53.697786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4855c6-3ebf-4a10-86b6-535f7e7f5ca6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:53.770355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.787958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e35fe1-f9cd-4aa8-8fd3-475ae604327f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.802492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:53.817504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4855c6-3ebf-4a10-86b6-535f7e7f5ca6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:53.824754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.825423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.825712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.825990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.857457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46ef4f-e516-4a26-9548-56719557336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:53.858396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46ef4f-e516-4a26-9548-56719557336d None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.858681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46ef4f-e516-4a26-9548-56719557336d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.859732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46ef4f-e516-4a26-9548-56719557336d None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188/users/ad700b628a6446b2a68917c406942540/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.860951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46ef4f-e516-4a26-9548-56719557336d None admin] RBAC: Authorizing `identity:create_grant(project_id=abfde98cb32b430f8d245d455a20a188, user_id=ad700b628a6446b2a68917c406942540, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.863026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46ef4f-e516-4a26-9548-56719557336d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:53.878786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:53 2022] PUT /identity/v3/projects/abfde98cb32b430f8d245d455a20a188/users/ad700b628a6446b2a68917c406942540/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:53.880184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:53.880476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:53.880754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:53.903317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:53.904451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:53.915828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:53.917396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:54.001736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 114/226] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:54.024988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:54.038830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:54.060958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 113/227] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:54.067253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:54.151800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:54.188742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75ee8-26a4-4d26-827a-f98e6ca6acf9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:54.229945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39e3cc-eb11-4d51-a7f7-57efcc86570e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:54.256700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:54.257523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:54.257803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:54.258080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:54.269943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:54.278519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:54.279405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:54.280178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 115/228] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:56:54.288663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:54.311945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:54.312809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:54.313088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:54.313363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:54.315769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:54.317225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:54.320132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 114/229] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:54 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:54.324946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:54.386927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:54.436057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64778753-8999-4f84-a1ad-3c91dd315818 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:54.479880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:54.480595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:54.480882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:54.481206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:54.481520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e115291-292c-4c1d-97f9-937129d47bee None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:54.482063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=1cda5e6489cf4fcd99c8707649fa77e1) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:54.482404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:54.484060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:54.496811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 115/230] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:54 2022] GET /identity/v3/role_assignments?user.id=1cda5e6489cf4fcd99c8707649fa77e1&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=f60d92c63c684ab6b89b982e4049558a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:54.525868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:54.526586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:54.526868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:54.527142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:54.527905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:54.528219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:54.529669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:54.539086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 116/231] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:54.544963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:54.706640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6724a-2d42-4e15-ac7a-283c0790d4bc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:54.734270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:54.756302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:54.757574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:54.758100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:54.758620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] PATH_INFO: `/v3/users/ad700b628a6446b2a68917c406942540` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:54.760382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] RBAC: Authorizing `identity:get_user(user_id=ad700b628a6446b2a68917c406942540)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:54.762034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:54.763895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:54 2022] GET /identity/v3/users/ad700b628a6446b2a68917c406942540 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:54.770106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:54.773402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:54.906591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bca548-2cce-4a4c-89ac-78389d5ac618 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:54.949175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab0397-c507-4a05-8c07-eb194ef372e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:54.950122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0397-c507-4a05-8c07-eb194ef372e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:54.950450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0397-c507-4a05-8c07-eb194ef372e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:54.950727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab0397-c507-4a05-8c07-eb194ef372e9 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:54.953741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab0397-c507-4a05-8c07-eb194ef372e9 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:54.955801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab0397-c507-4a05-8c07-eb194ef372e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:54.957817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:54 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:54.963200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:55.132410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b95436-f124-4df8-a9b9-51f3f24df366 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:55.183026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603147-0036-4d51-955a-070ead456cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:55.183837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603147-0036-4d51-955a-070ead456cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:55.184117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603147-0036-4d51-955a-070ead456cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:55.184390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603147-0036-4d51-955a-070ead456cb8 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188/users/ad700b628a6446b2a68917c406942540/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:55.188071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c603147-0036-4d51-955a-070ead456cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=abfde98cb32b430f8d245d455a20a188, user_id=ad700b628a6446b2a68917c406942540, role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:55.190354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c603147-0036-4d51-955a-070ead456cb8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:55.216214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:54 2022] PUT /identity/v3/projects/abfde98cb32b430f8d245d455a20a188/users/ad700b628a6446b2a68917c406942540/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:56.219687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd28e-b505-4b21-8e4b-53dd1730d42b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.219687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd28e-b505-4b21-8e4b-53dd1730d42b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.219687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd28e-b505-4b21-8e4b-53dd1730d42b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.221317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 118/235] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:56.226886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be0c1-b9f4-4e2c-85d8-3bd1614765a8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.227290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be0c1-b9f4-4e2c-85d8-3bd1614765a8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.227434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6be0c1-b9f4-4e2c-85d8-3bd1614765a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.251178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cb6be0c1-b9f4-4e2c-85d8-3bd1614765a8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:56.252620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cb6be0c1-b9f4-4e2c-85d8-3bd1614765a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:56.308705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:56.344865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 118/236] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:56.353093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2c72-ea8d-490f-9462-47aa8b7cddcd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.353381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2c72-ea8d-490f-9462-47aa8b7cddcd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.353903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2c72-ea8d-490f-9462-47aa8b7cddcd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.358878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 119/237] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:56.364189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f22ae-3f97-4ac6-a09e-caf664664cf6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.364482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f22ae-3f97-4ac6-a09e-caf664664cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.364762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f22ae-3f97-4ac6-a09e-caf664664cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.373930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2c72-ea8d-490f-9462-47aa8b7cddcd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:56.394587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c26f22ae-3f97-4ac6-a09e-caf664664cf6 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:56.395777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c26f22ae-3f97-4ac6-a09e-caf664664cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:56.501814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:56.509695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 119/238] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:56.511219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2444a-734a-47ed-b289-5c2623cfc384 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.511675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2444a-734a-47ed-b289-5c2623cfc384 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.512092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2444a-734a-47ed-b289-5c2623cfc384 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.513487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 120/239] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:56.527488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.527955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.528396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.548175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:56.550354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:56.553909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2c72-ea8d-490f-9462-47aa8b7cddcd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:56.587742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:56.588817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.589240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.589695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.600940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:56.608994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:56.610044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:56:56.611047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:56.613995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 120/240] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:56.614983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:56.629940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 121/241] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 08:56:56.631051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:56.682835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:56.739101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46993cdf-7f86-4adf-8776-683bfacc216a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:56.768989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340c100-94e7-4e9b-8f0b-ad2247722905 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:56.769463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:56.776858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:56.777930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.778479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.778953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.780513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:56.782132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:56.784567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 121/242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:56.785534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:56.811062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:56.811912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.812445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.812551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.813342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:56.813637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:56.815222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:56.829020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 122/243] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:56.830942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:56.895984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f9e8-2d7a-4aa2-a5b1-d53a1070ff36 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:56.932047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:56.933216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.933720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.934190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.938369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:56.943048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275272-836b-4eb8-9e44-07a8daa78773 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:56.946452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:56.954582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:56.956004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:56:56.956800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:56:56.959458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 122/244] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:56.960520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:56.990943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:56.991962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:56.992445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:56.992937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:56.993829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:56.996350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.025544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 123/245] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:56:56 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:56:57.027260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:57.062429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.123057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce5737-e3c0-44b7-a45a-433545ec1452 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.167555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bdb5d-d7ba-4ad1-b151-4e38649e486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.169358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bdb5d-d7ba-4ad1-b151-4e38649e486f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.169841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bdb5d-d7ba-4ad1-b151-4e38649e486f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.170443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bdb5d-d7ba-4ad1-b151-4e38649e486f None admin] PATH_INFO: `/v3/users/8af605bc9d4742ecb7a26a6834fc6aaf` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.170706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba637407-47cb-48ad-b37e-15e22f70aa0b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.186270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bdb5d-d7ba-4ad1-b151-4e38649e486f None admin] RBAC: Authorizing `identity:get_user(user_id=8af605bc9d4742ecb7a26a6834fc6aaf)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:57.188055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bdb5d-d7ba-4ad1-b151-4e38649e486f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.190755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 123/246] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:56 2022] GET /identity/v3/users/8af605bc9d4742ecb7a26a6834fc6aaf => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:57.192217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fd4e-27c1-481c-a417-28b0496efb81 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.192573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fd4e-27c1-481c-a417-28b0496efb81 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.192940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fd4e-27c1-481c-a417-28b0496efb81 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.198126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 124/247] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:57.198126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745fd4e-27c1-481c-a417-28b0496efb81 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:57.214785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.215462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.215748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.216029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.216842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:57.217185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:57.219656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd1f3-a858-441c-99b8-90586d7badce None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.227572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 124/248] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:57.228857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.229098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.229381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.247635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:57.248766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:57.264260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.329494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745fd4e-27c1-481c-a417-28b0496efb81 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.336376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 125/249] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:57.337612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:57.351047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.376290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.377119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.377711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.378331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.466624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5f76-56d6-469b-952c-9afcc3f3186f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.469742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:57.472316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.516434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.516816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.517108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.517391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] PATH_INFO: `/v3/users/ad700b628a6446b2a68917c406942540` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.519799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] RBAC: Authorizing `identity:get_user(user_id=ad700b628a6446b2a68917c406942540)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:57.521786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.524239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 126/250] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/users/ad700b628a6446b2a68917c406942540 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:57.526973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:57.545148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.616358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 125/251] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:57.621472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:57.650675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e9d52-c066-4758-bdf4-f5c47be2fab5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.650860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.743661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.744395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.744745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.745019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.754899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789032-2b81-4b9e-a540-bb8c6ccbeae2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.768260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:57.782770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:57.784246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:56:57.785041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:57.785642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:57.786410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:57.812238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bd7b1-f675-4e07-9a6c-0f0967a5e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.813305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd7b1-f675-4e07-9a6c-0f0967a5e005 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.813744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd7b1-f675-4e07-9a6c-0f0967a5e005 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.814358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd7b1-f675-4e07-9a6c-0f0967a5e005 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.880797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.909943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6eecb-1e1e-4d00-9a99-842ec0e08e96 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:57.931665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd7b1-f675-4e07-9a6c-0f0967a5e005 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:57.933936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd7b1-f675-4e07-9a6c-0f0967a5e005 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.951428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:57.952662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:57.953092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:57.953529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:57.954936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.956309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:57.958122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:57.960128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 128/253] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:57.962105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.057871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 126/254] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:58.057871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e3fd-194f-40fe-a93a-ddf329c3949b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.057871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e3fd-194f-40fe-a93a-ddf329c3949b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.057871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9e3fd-194f-40fe-a93a-ddf329c3949b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.057871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 127/255] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:58.057871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e3fd-194f-40fe-a93a-ddf329c3949b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.088198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15215df0-0f30-48cb-80b5-008e6bedccf2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.125569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.126575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.127600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.128025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.129072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:58.129601 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:58.131213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:58.140516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 129/256] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:58.146593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.151308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:58.171219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9e3fd-194f-40fe-a93a-ddf329c3949b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.190016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:58.209192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.209861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.210145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.210454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.211458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] RBAC: Adding query filter params (role.id=bd66dea4a80644bdb90f1f0208ea11de, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=8af605bc9d4742ecb7a26a6834fc6aaf) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:58.211776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:58.213329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4714-d91d-471e-b7ef-091a620228a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:58.219480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 128/257] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/role_assignments?user.id=8af605bc9d4742ecb7a26a6834fc6aaf&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=bd66dea4a80644bdb90f1f0208ea11de => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:58.220804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.221091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.221370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.255549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:58.256939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:58.266999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8329a2-3031-470f-ac06-acebfc8c6b50 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.308535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.309913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.310430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.310892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.312463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:58.314267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:58.321801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 130/258] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:58.323051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.384949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 129/259] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:56:58.384949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.430579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:58.466417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab5863-bc7c-4979-ae0b-5911bb77d0f2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.499906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38174330-6532-44ee-9244-ba52065e6f47 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.504602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.505712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.506214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.506688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] PATH_INFO: `/v3/users/1cda5e6489cf4fcd99c8707649fa77e1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.508253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] RBAC: Authorizing `identity:get_user(user_id=1cda5e6489cf4fcd99c8707649fa77e1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:58.510041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:58.511632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:58.513087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 131/260] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/users/1cda5e6489cf4fcd99c8707649fa77e1 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:58.519323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.556921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.557637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.557922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.558286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.559110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=ad700b628a6446b2a68917c406942540) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:58.559367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:58.560825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:58.573413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 130/261] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/role_assignments?user.id=ad700b628a6446b2a68917c406942540&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:58.575422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.754616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7fe9-0eba-4234-8740-236039ae8639 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.826536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.827051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.827624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.840986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2f1b-68a5-4cca-810a-cbfcf1818e55 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:58.844046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:56:58.854182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:56:58.856525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:56:58.857407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:56:58.858265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:56:58.862550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:56:58.867669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.948379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:58.949400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:58.949544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:58.949831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:58.955678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:58.956952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:58.962245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 131/263] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:58.979190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:58.981451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062ba1-d375-40cf-9a82-94ec05b583a6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:59.017020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:59.018623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.019117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.019626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.020633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:59.021176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:59.022799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:59.036912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 133/264] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:56:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:59.038460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:59.104500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.124597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.147684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e062f-3fec-4f38-88b3-5b3df7ba9aa4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:59.184346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:59.185237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.185522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.185804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] PATH_INFO: `/v3/users/ad700b628a6446b2a68917c406942540` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.187353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] RBAC: Authorizing `identity:get_user(user_id=ad700b628a6446b2a68917c406942540)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:59.188940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:59.191412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 134/265] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:56:59 2022] GET /identity/v3/users/ad700b628a6446b2a68917c406942540 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:59.196929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:59.301228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dbe88-02ac-43a7-86e4-6ff020dbe356 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:59.334617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.336357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6856c-3e9a-494b-a453-293c38313152 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:59.337381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:59.338086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.338442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.338794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.411215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:59.412682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:59.438940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:59.439887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.440175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.440454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188/users/1cda5e6489cf4fcd99c8707649fa77e1/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.451043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] RBAC: Authorizing `identity:create_grant(project_id=abfde98cb32b430f8d245d455a20a188, user_id=1cda5e6489cf4fcd99c8707649fa77e1, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:59.452520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:59.489237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 132/266] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:56:58 2022] PUT /identity/v3/projects/abfde98cb32b430f8d245d455a20a188/users/1cda5e6489cf4fcd99c8707649fa77e1/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:56:59.543689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 135/267] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:59.549140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:59.680727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141e04-e4f8-41c5-9d04-588578dbad45 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:59.682337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.719745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74478e-b8e0-478e-be2f-ef6b58555fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:59.720667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74478e-b8e0-478e-be2f-ef6b58555fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.721467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74478e-b8e0-478e-be2f-ef6b58555fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.721800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74478e-b8e0-478e-be2f-ef6b58555fa6 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.723038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74478e-b8e0-478e-be2f-ef6b58555fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:59.724506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74478e-b8e0-478e-be2f-ef6b58555fa6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:59.726654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 133/268] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:56:59 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:56:59.733248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:59.767559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:59.793662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24210b-4070-4bfc-ad18-8b25fcbe69e1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.793967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24210b-4070-4bfc-ad18-8b25fcbe69e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.794274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24210b-4070-4bfc-ad18-8b25fcbe69e1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.796889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 134/269] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:59.801839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26dc7c-6463-4af4-a52c-518468920690 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.802126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26dc7c-6463-4af4-a52c-518468920690 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.802435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26dc7c-6463-4af4-a52c-518468920690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.836531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ee26dc7c-6463-4af4-a52c-518468920690 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:59.838711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ee26dc7c-6463-4af4-a52c-518468920690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:56:59.868781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5470e13-bb4b-46c5-8b65-ef251379776c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:59.912316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:59.913097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.913688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.914038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.914971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] RBAC: Adding query filter params (role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=ad700b628a6446b2a68917c406942540) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:56:59.915509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:59.917346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d50d8-b086-48ed-b3ba-097cf972a3b4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:59.925330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 135/271] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:56:59.925465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 136/271] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:56:59 2022] GET /identity/v3/role_assignments?user.id=ad700b628a6446b2a68917c406942540&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:56:59.930278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589be6-02ac-4dbe-b32d-7a64546939c6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.930278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589be6-02ac-4dbe-b32d-7a64546939c6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.930278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb589be6-02ac-4dbe-b32d-7a64546939c6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.930278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 137/272] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:56:59.934375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:59.934589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:59.934864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:59.952730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:56:59.953214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589be6-02ac-4dbe-b32d-7a64546939c6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:59.954074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:00.056925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 136/273] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:00.075033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:00.083142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:00.086042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb589be6-02ac-4dbe-b32d-7a64546939c6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:00.115378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:00.122487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:00.123631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.124110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.124576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.125942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:00.128186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:00.130387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 138/274] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:56:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:00.144090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:00.204885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ee767-0ed8-4cf5-8f9e-02d60076a414 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:00.260158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:00.260991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.261281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.261562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.276253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:00.286811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:00.287706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:00.288484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 137/275] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:00.293962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:00.306858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fd692-02df-4821-b766-6e61c1d56884 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:00.353981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:00.355049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.355629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.356133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.357564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:00.359746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:00.389903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 139/276] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:00 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:00.412535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:00.424891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec8e6-ba45-466f-bffe-206ed1a268ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:00.470322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:00.470953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.471319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.471652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.472494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:00.472862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:00.474470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:00.489462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 138/277] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:00.493112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:00.519766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:00.611394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a671701-8c1d-474d-b984-0b39731862bc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:00.647728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe849b-900d-4d07-923b-4d7a694342c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:00.648614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe849b-900d-4d07-923b-4d7a694342c1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.648903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe849b-900d-4d07-923b-4d7a694342c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.649185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe849b-900d-4d07-923b-4d7a694342c1 None admin] PATH_INFO: `/v3/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.664153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe849b-900d-4d07-923b-4d7a694342c1 None admin] RBAC: Authorizing `identity:get_user(user_id=db6d8c7c5d914c2a95f9e4b6dc1e9c54)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:00.665637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe849b-900d-4d07-923b-4d7a694342c1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:00.667571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 140/278] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:00 2022] GET /identity/v3/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:00.673302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:00.787970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5af29-dc39-4300-94d6-4ce65f037198 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:00.826433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:00.827400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.827866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.828334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.829183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, user.id=db6d8c7c5d914c2a95f9e4b6dc1e9c54, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:00.829504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:00.831108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:00.834871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d272-a7f6-4f73-a619-43c54af4145f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.835709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d272-a7f6-4f73-a619-43c54af4145f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.836194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d272-a7f6-4f73-a619-43c54af4145f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.837802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 141/280] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:00.839691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 139/280] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 08:57:00 2022] GET /identity/v3/role_assignments?user.id=db6d8c7c5d914c2a95f9e4b6dc1e9c54&scope.system=all&role.id=f60d92c63c684ab6b89b982e4049558a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:00.843528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:00.844110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:00.844612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:00.875672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:00.877267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:00.978889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 142/281] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:01.014558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:01.035853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:01.147710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d98e1-dfe4-4da8-a6c1-1418a5031939 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:01.195903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:01.196719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:01.197006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:01.197285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:01.212823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:01.227224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:01.228152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:01.228949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 140/282] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:01.234578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:01.244319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:01.358333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaeec2-25ae-4084-8afc-153a13aac48b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:01.393627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:01.394332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:01.394623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:01.394905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:01.398150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:01.398722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:01.400311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:01.413047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 143/283] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:01.423372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:01.544319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:01.574244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2718b8b-c1c3-4138-a1e1-02c95a3e8a31 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:01.627016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c9cd2-3e3e-4c49-ad18-f0dec48c96a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:01.627892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9cd2-3e3e-4c49-ad18-f0dec48c96a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:01.628175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9cd2-3e3e-4c49-ad18-f0dec48c96a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:01.628455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9cd2-3e3e-4c49-ad18-f0dec48c96a6 None admin] PATH_INFO: `/v3/users/8af605bc9d4742ecb7a26a6834fc6aaf` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:01.635402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c9cd2-3e3e-4c49-ad18-f0dec48c96a6 None admin] RBAC: Authorizing `identity:get_user(user_id=8af605bc9d4742ecb7a26a6834fc6aaf)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:01.640156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c9cd2-3e3e-4c49-ad18-f0dec48c96a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:01.643838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 141/284] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:01 2022] GET /identity/v3/users/8af605bc9d4742ecb7a26a6834fc6aaf => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:01.648914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:01.743108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:01.785848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29718eba-20f4-48d2-b520-d2166867a77b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:01.828819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:01.829691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:01.830006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:01.830315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:01.834959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:01.836416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:01.838126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 144/285] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:01 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:01.840893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328dbaf-f9e0-4243-ace6-0c67faf31587 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:01.841429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328dbaf-f9e0-4243-ace6-0c67faf31587 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:01.841909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328dbaf-f9e0-4243-ace6-0c67faf31587 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:01.843530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:01.844132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 142/286] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:01.849517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:01.850040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:01.850543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:01.883506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:01.885572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:02.011850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 143/287] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:02.026536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306bd7-8f7f-4fb7-8b0a-8964162202a2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:02.063129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:02.102880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:02.103793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:02.104082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:02.104356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188/users/8af605bc9d4742ecb7a26a6834fc6aaf/roles/bd66dea4a80644bdb90f1f0208ea11de` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:02.107568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] RBAC: Authorizing `identity:create_grant(project_id=abfde98cb32b430f8d245d455a20a188, user_id=8af605bc9d4742ecb7a26a6834fc6aaf, role_id=bd66dea4a80644bdb90f1f0208ea11de)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:02.109024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:02.119879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:02.138431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:01 2022] PUT /identity/v3/projects/abfde98cb32b430f8d245d455a20a188/users/8af605bc9d4742ecb7a26a6834fc6aaf/roles/bd66dea4a80644bdb90f1f0208ea11de => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:57:02.183955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:02.225069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86fb9-b98b-43dd-a0df-2af94138abc3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:02.276972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:02.277709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:02.277995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:02.278367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:02.296192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:02.306381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:02.307320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:02.308094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:02.313570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:02.443856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e608a8-281a-412c-b4fb-dee77fe3aa5b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:02.477105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:02.477774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:02.478057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:02.478409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:02.479157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:02.479464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:02.480833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:02.489125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:02.494512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:02.599093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc085f8c-187c-4889-a341-5e07ecc24aa3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:02.645391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:02.646291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:02.646578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:02.646860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] PATH_INFO: `/v3/users/1cda5e6489cf4fcd99c8707649fa77e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:02.648107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] RBAC: Authorizing `identity:get_user(user_id=1cda5e6489cf4fcd99c8707649fa77e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:02.649545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:02.651532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 145/291] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:02 2022] GET /identity/v3/users/1cda5e6489cf4fcd99c8707649fa77e1 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:02.657059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:02.744250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:02.795116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aad1f6-f781-48bc-9d06-6f4f11447eb3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:02.840294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0f7e5-83dd-496e-b276-201d341a3dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:02.840955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f7e5-83dd-496e-b276-201d341a3dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:02.841238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f7e5-83dd-496e-b276-201d341a3dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:02.841516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0f7e5-83dd-496e-b276-201d341a3dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:02.926423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f7e5-83dd-496e-b276-201d341a3dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:02.927806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0f7e5-83dd-496e-b276-201d341a3dd7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:02.997372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.046697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 147/292] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:03.052550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.056443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.187324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee46e5-b7fd-417c-be7c-5450935b0667 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.197584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f4a95-1f35-46be-8403-14c10091b102 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.198179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f4a95-1f35-46be-8403-14c10091b102 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.198686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f4a95-1f35-46be-8403-14c10091b102 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.200490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 148/293] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:03.206138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17792cd-f71d-4409-a527-71a0440cd674 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.206683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17792cd-f71d-4409-a527-71a0440cd674 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.207175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17792cd-f71d-4409-a527-71a0440cd674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.224713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d17792cd-f71d-4409-a527-71a0440cd674 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:03.226290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d17792cd-f71d-4409-a527-71a0440cd674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:03.229987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.230945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.231238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.231519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.237357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:03.238853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:03.240896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 146/294] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:03.250261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.333932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 149/295] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:03.335555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374f41-7c20-4dfa-95fa-a8eee27bc85b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.335979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374f41-7c20-4dfa-95fa-a8eee27bc85b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.336389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374f41-7c20-4dfa-95fa-a8eee27bc85b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.341769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 150/296] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:03.343100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.343559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.344004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.349087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.363171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:03.364632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:03.391013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655211b5-0fb5-4082-b5ae-2391616c25fd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.436080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.436743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.437027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.437303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.437742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 151/297] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:03.438145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=1cda5e6489cf4fcd99c8707649fa77e1) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:03.438499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:03.440266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14dff6-d9c1-4114-bbba-c3b720df5350 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:03.442610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.452036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 147/298] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/role_assignments?user.id=1cda5e6489cf4fcd99c8707649fa77e1&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=f60d92c63c684ab6b89b982e4049558a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:03.453750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d4d2-a1d4-499c-bcb8-841fe5a9ab8f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.454182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d4d2-a1d4-499c-bcb8-841fe5a9ab8f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.454615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d4d2-a1d4-499c-bcb8-841fe5a9ab8f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.457012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 148/299] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:03.462715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.463003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.463273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.472449 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.493501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:03.495208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:03.570043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336453d-47d1-4404-8c7a-11f98f9c1d2a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.592291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 149/300] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:03.593379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.627605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.628418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.628701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.628974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.644485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:03.654167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:03.655251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:03.656229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:03.659222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 152/301] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:03.665020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.685580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.732042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bb1c6-5dc4-4ad1-bc3a-889a58e39ee6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.757415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.773861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.774673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.774954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.775383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.780907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7afbc-5c4e-4709-a58c-491816895d55 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.786829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:03.794395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:03.795289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 150/302] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:03.801048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.824489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df796-1281-4832-b260-00514c680995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.825314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df796-1281-4832-b260-00514c680995 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.825713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df796-1281-4832-b260-00514c680995 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.825990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df796-1281-4832-b260-00514c680995 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.827416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df796-1281-4832-b260-00514c680995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:03.828949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df796-1281-4832-b260-00514c680995 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:03.831941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 153/303] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:03.832674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df796-1281-4832-b260-00514c680995 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.906694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c165ad9-2e56-46d5-b189-84ac50e24fb4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.930840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:03.937366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df796-1281-4832-b260-00514c680995 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:03.943663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.944341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.945044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.945333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.946091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:03.946783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:03.948496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:03.962242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 151/304] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:03.962242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:03.974587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:03.975254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:03.975538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:03.975867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:03.976613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:03.976972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:03.978416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:03.986786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 154/305] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:03.991924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:04.003968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:04.076855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7544f61-fb9f-4647-9eec-95dc75a29f2f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:04.099080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f19b-2dcb-435d-8a61-e89849384d85 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:04.118006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:04.118704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.118986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.119778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] PATH_INFO: `/v3/groups` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.120541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:04.121876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:04.134369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:04.135232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.135512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.135839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] PATH_INFO: `/v3/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.136358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 152/306] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Jun 24 08:57:03 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:04.137147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:04.147721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] RBAC: Authorizing `identity:get_user(user_id=db6d8c7c5d914c2a95f9e4b6dc1e9c54)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:04.149495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:04.156106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 155/307] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:03 2022] GET /identity/v3/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:04.157422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:04.202270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:04.267921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:04.271572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcf439-908e-4b3d-8918-de64f7170136 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:04.301420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aef40-364a-42fc-8e61-9b1c09fd6070 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:04.309062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:04.310012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.310339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.310617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] PATH_INFO: `/v3/users/01481939805d457fa7a25cbb7d8b168f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.327818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] RBAC: Authorizing `identity:get_user(user_id=01481939805d457fa7a25cbb7d8b168f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:04.329272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:04.331974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 153/308] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:04 2022] GET /identity/v3/users/01481939805d457fa7a25cbb7d8b168f => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:04.337928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:04.357328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de46a4f-20a6-41bc-82d7-95e6b8eac187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:04.358202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de46a4f-20a6-41bc-82d7-95e6b8eac187 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.358535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de46a4f-20a6-41bc-82d7-95e6b8eac187 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.358814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de46a4f-20a6-41bc-82d7-95e6b8eac187 None admin] PATH_INFO: `/v3/system/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.360449 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de46a4f-20a6-41bc-82d7-95e6b8eac187 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db6d8c7c5d914c2a95f9e4b6dc1e9c54, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:04.361908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de46a4f-20a6-41bc-82d7-95e6b8eac187 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:04.373226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 156/309] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Jun 24 08:57:04 2022] PUT /identity/v3/system/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:04.470482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8b262-077a-4a34-b598-9592169c8692 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:04.473335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:04.512335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:04.513013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.513296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.513570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.514460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] RBAC: Adding query filter params (role.id=bd66dea4a80644bdb90f1f0208ea11de, user.id=01481939805d457fa7a25cbb7d8b168f, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:04.514775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:04.516313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062f6ef-878e-49a3-a60f-3cd2530292bd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:04.522953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 154/310] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 08:57:04 2022] GET /identity/v3/role_assignments?user.id=01481939805d457fa7a25cbb7d8b168f&scope.system=all&role.id=bd66dea4a80644bdb90f1f0208ea11de => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:04.774922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8628f6-4be7-4d15-8246-017693f4c730 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.775398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8628f6-4be7-4d15-8246-017693f4c730 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.775398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8628f6-4be7-4d15-8246-017693f4c730 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.777004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 157/311] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:04.782156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:04.782591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:04.782762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:04.803538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:04.805038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:04.879400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 155/312] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:04.902956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8628f6-4be7-4d15-8246-017693f4c730 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:05.008030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8628f6-4be7-4d15-8246-017693f4c730 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:05.045447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:05.046254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:05.046542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:05.046821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:05.055094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:05.060968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:05.069825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:05.070739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:05.071543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:05.074297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 158/313] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:05.079699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:05.178989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:05.182823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c795d2-1b46-470a-a5ea-2ed1b6184039 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:05.218399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:05.219074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:05.219358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:05.219633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:05.220402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:05.221229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:05.222622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:05.231052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:05.237113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:05.340559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f368f3-3d7d-4405-81f3-f7559a0250dc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:05.376754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:05.377615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:05.377904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:05.378183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] PATH_INFO: `/v3/users/8af605bc9d4742ecb7a26a6834fc6aaf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:05.379429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] RBAC: Authorizing `identity:get_user(user_id=8af605bc9d4742ecb7a26a6834fc6aaf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:05.380884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:05.382886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 159/315] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:05 2022] GET /identity/v3/users/8af605bc9d4742ecb7a26a6834fc6aaf => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:05.387876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:05.497431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c165c-302d-40a7-9ecb-ac82c5a131c1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:05.537940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:05.538955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:05.539431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:05.539920 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:05.573808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:05.618107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:05.619608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:05.723871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:05.729003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:05.803090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:05.836662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77089-7ca2-4893-a4e6-90e41a015a3f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:05.871578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c9831-2e42-42ab-82da-0df25ab12013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:05.872370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c9831-2e42-42ab-82da-0df25ab12013 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:05.872652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c9831-2e42-42ab-82da-0df25ab12013 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:05.872925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c9831-2e42-42ab-82da-0df25ab12013 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:05.874145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c9831-2e42-42ab-82da-0df25ab12013 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:05.875623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c9831-2e42-42ab-82da-0df25ab12013 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:05.878145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:05 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:05.883985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:05.947482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:05.990070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba450-99f3-4175-b1d0-393604825f2b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:06.031059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:06.031731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.032010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.032283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.033745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] RBAC: Adding query filter params (role.id=bd66dea4a80644bdb90f1f0208ea11de, scope.project.id=abfde98cb32b430f8d245d455a20a188, user.id=8af605bc9d4742ecb7a26a6834fc6aaf) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:06.034053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:06.035510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c2651-8f13-4739-b422-9f9741c820db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:06.042256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 158/318] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:05 2022] GET /identity/v3/role_assignments?user.id=8af605bc9d4742ecb7a26a6834fc6aaf&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=bd66dea4a80644bdb90f1f0208ea11de => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:06.475029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ab58-d4b9-4335-a36f-ade20eab0285 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.475750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ab58-d4b9-4335-a36f-ade20eab0285 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.476231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18ab58-d4b9-4335-a36f-ade20eab0285 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.477808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 161/319] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:06.483163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3241b-c34f-4c23-9bb5-beee6a63da8f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.483680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3241b-c34f-4c23-9bb5-beee6a63da8f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.484168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3241b-c34f-4c23-9bb5-beee6a63da8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.487249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8cd1-d822-4f28-b56f-5aae2a8b2c6d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.487543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8cd1-d822-4f28-b56f-5aae2a8b2c6d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.487823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8cd1-d822-4f28-b56f-5aae2a8b2c6d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.489160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 162/320] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:06.494289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876366-7de9-4077-8407-fcc7c778ca03 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.494588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876366-7de9-4077-8407-fcc7c778ca03 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.494864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876366-7de9-4077-8407-fcc7c778ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.501539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-abd3241b-c34f-4c23-9bb5-beee6a63da8f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:06.503302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-abd3241b-c34f-4c23-9bb5-beee6a63da8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:06.511778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bf876366-7de9-4077-8407-fcc7c778ca03 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:06.512957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bf876366-7de9-4077-8407-fcc7c778ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:06.577976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 159/321] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:06.580470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df667-37e5-4d2b-8c7f-5b1a905ca3d3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.580784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df667-37e5-4d2b-8c7f-5b1a905ca3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.581059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8df667-37e5-4d2b-8c7f-5b1a905ca3d3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.581998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:06.582536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 160/323] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:57:06.587607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.587898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.588177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.596578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df667-37e5-4d2b-8c7f-5b1a905ca3d3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:06.605630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:06.606825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:06.653468 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:06.664979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:06.673311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 164/324] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:06.674924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:06.703862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8df667-37e5-4d2b-8c7f-5b1a905ca3d3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:06.737676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:06.738425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.738703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.738973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.740115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:06.741781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:06.743423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 161/325] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:06.744175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:06.777117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597673a9-5320-4979-9ef2-b0f86942d224 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:06.810002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:06.810811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.811091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.811365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.821227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:06.828884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:06.829800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 165/326] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:06.831048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:06.846680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cdd88-5510-470e-b015-5bc90f94d2fd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:06.870197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:06.882006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:06.882830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.883115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.883388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.889870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:06.893763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:06.901516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:06.902585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 162/327] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:06.903419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:06.937612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311dc01-9fd8-4744-9b78-955615b0b8f3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:06.971297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:06.971948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:06.972229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:06.972502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] PATH_INFO: `/v3/groups` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:06.973177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:06.974621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:06.989245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 166/328] 10.222.0.16 () {60 vars in 1134 bytes} [Fri Jun 24 08:57:06 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:06.989975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:07.016444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095ddee-20d6-4dad-81bf-513380868f9d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:07.058264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:07.058957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:07.059251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:07.059546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:07.060316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:07.060627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:07.062273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:07.073191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 163/329] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:07.078573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:07.114211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c2d6-949b-4e1c-94d9-bfc35e5d7e5a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:07.131932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:07.134594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:07.155237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:07.156104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:07.156221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:07.156470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:07.157218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:07.157529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:07.159002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:07.168890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 167/330] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:07.174934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:07.200276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6a2f-9ec5-43c5-bf59-6a7a6eeaeb9d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:07.245763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:07.246615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:07.246901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:07.247176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] PATH_INFO: `/v3/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:07.248401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] RBAC: Authorizing `identity:get_user(user_id=db6d8c7c5d914c2a95f9e4b6dc1e9c54)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:07.249866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:07.252495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 164/331] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:07 2022] GET /identity/v3/users/db6d8c7c5d914c2a95f9e4b6dc1e9c54 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:07.258474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:07.298428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763698d-abf9-4c29-941b-841d05bb2328 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:07.342481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:07.343889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:07.345067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:07.345407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] PATH_INFO: `/v3/users/01481939805d457fa7a25cbb7d8b168f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:07.349072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] RBAC: Authorizing `identity:get_user(user_id=01481939805d457fa7a25cbb7d8b168f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:07.349072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:07.350096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 168/332] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:07 2022] GET /identity/v3/users/01481939805d457fa7a25cbb7d8b168f => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:07.355508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:07.386862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd37fa4-ceed-4816-ab13-aae21c847cff None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:07.407584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:07.417548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:07.437813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:07.439972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:07.440723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:07.441208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:07.442306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] RBAC: Adding query filter params (role.id=f60d92c63c684ab6b89b982e4049558a, user.id=db6d8c7c5d914c2a95f9e4b6dc1e9c54, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:07.442813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:07.445266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaa3f6-028a-445b-8f24-f7b02b0bf1fa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:07.462259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 08:57:07 2022] GET /identity/v3/role_assignments?user.id=db6d8c7c5d914c2a95f9e4b6dc1e9c54&scope.system=all&role.id=f60d92c63c684ab6b89b982e4049558a => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:07.487660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac580a-e807-435d-b32a-8591f50cb67e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:07.526386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766b064-47cc-4ea8-bbf4-0575217dd294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:07.527549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b064-47cc-4ea8-bbf4-0575217dd294 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:07.528005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b064-47cc-4ea8-bbf4-0575217dd294 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:07.528467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766b064-47cc-4ea8-bbf4-0575217dd294 None admin] PATH_INFO: `/v3/system/users/01481939805d457fa7a25cbb7d8b168f/roles/bd66dea4a80644bdb90f1f0208ea11de` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:07.530215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766b064-47cc-4ea8-bbf4-0575217dd294 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=01481939805d457fa7a25cbb7d8b168f, role_id=bd66dea4a80644bdb90f1f0208ea11de)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:07.531808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766b064-47cc-4ea8-bbf4-0575217dd294 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:07.544314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 169/334] 10.222.0.16 () {58 vars in 1334 bytes} [Fri Jun 24 08:57:07 2022] PUT /identity/v3/system/users/01481939805d457fa7a25cbb7d8b168f/roles/bd66dea4a80644bdb90f1f0208ea11de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:57:09.398679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ada653-0afa-4b5d-8cd0-86c393fc9e10 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:09.399186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ada653-0afa-4b5d-8cd0-86c393fc9e10 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:09.399262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ada653-0afa-4b5d-8cd0-86c393fc9e10 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:09.400901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:09.406555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6415e2-d4c3-4b9e-9a59-ab0e77d771c5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:09.407010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6415e2-d4c3-4b9e-9a59-ab0e77d771c5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:09.407190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6415e2-d4c3-4b9e-9a59-ab0e77d771c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:09.429366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8d6415e2-d4c3-4b9e-9a59-ab0e77d771c5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:09.430604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8d6415e2-d4c3-4b9e-9a59-ab0e77d771c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:09.516884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:09.565274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ada653-0afa-4b5d-8cd0-86c393fc9e10 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:09.693506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ada653-0afa-4b5d-8cd0-86c393fc9e10 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:09.743610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1cb8-54ea-4286-9579-fb339803fb91 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:09.744058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1cb8-54ea-4286-9579-fb339803fb91 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:09.744304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c1cb8-54ea-4286-9579-fb339803fb91 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:09.745703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 171/337] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:09.746885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:09.747785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:09.748174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:09.748459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:09.751328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:09.751679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:09.751985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:09.764236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:09.773004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:09.773927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:09.774764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:09.777058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 167/338] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:09.783913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:09.785132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:09.787988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:09.852533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:09.859800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:09.920849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 172/339] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:09.968185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57675378-5d59-4235-a255-0f2bb120de64 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.004594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.033570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.034286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.034571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.034847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.035601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:10.035906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:10.037272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:10.049831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 168/340] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:10.075624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.199478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48d6a-6c1f-45c2-8843-b01a140546ba None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.254535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.270985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae06421-539b-4ddf-83f4-641bbd79ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.273364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f47895-cf96-4300-a350-2634288643c1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.275104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae06421-539b-4ddf-83f4-641bbd79ea43 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.275392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae06421-539b-4ddf-83f4-641bbd79ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.275671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae06421-539b-4ddf-83f4-641bbd79ea43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.295723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae06421-539b-4ddf-83f4-641bbd79ea43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7ae06421-539b-4ddf-83f4-641bbd79ea43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:10.305402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:10.306395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:10.307393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:10.309498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 173/341] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:10.310837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4c411-2e94-4b47-8340-c3875e9b690c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.311133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4c411-2e94-4b47-8340-c3875e9b690c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.311416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4c411-2e94-4b47-8340-c3875e9b690c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.313112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 174/342] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:10.314320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e4b6-39e5-4a1c-9fa5-ed0cf46126e9 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.314612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e4b6-39e5-4a1c-9fa5-ed0cf46126e9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.314889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e4b6-39e5-4a1c-9fa5-ed0cf46126e9 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.316244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 175/343] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:10.320689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.320986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.321268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.336506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f23bf-d70a-43a1-8779-6882a35ec55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.337272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f23bf-d70a-43a1-8779-6882a35ec55e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.337557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f23bf-d70a-43a1-8779-6882a35ec55e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.337831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f23bf-d70a-43a1-8779-6882a35ec55e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.339907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:10.342047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:10.377150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.422739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f23bf-d70a-43a1-8779-6882a35ec55e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:10.424796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f23bf-d70a-43a1-8779-6882a35ec55e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:10.432255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 176/344] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:10.433195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.532519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.548916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3828-1966-46c9-a9c2-28cd523e06c1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.549095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 169/345] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:10.550414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.550710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.550990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.569444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:10.571076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:10.587313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.587983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.588264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.588535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.589287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:10.589595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:10.591336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:10.600277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 177/346] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:10.600904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.627733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.649396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 170/347] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:10.650155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.712737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8249a-f63f-45f2-9bf0-0b48124d8a7c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.750188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.751015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.751296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.751600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.763339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:10.765425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9975272-6614-4bb5-b16f-5a88104ff618 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:10.771437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:10.773506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 178/348] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:10.775694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.791991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.807926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.808807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.809089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.809366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.810607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:10.812258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:10.817812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 171/349] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:10.818788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:10.863656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.885149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0093398-981b-4dd3-b1ff-6fd1bae1e86d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.920013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.920713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.921005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.921278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.940563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8f667-d2c5-4bd7-8eb6-423b6a9e4ce4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:10.978851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:10.979654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:10.979942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:10.980222 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:10.991623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:10.992356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:10.993118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:11.000308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:11.003058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 172/350] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:11.004995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.068450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.078471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.097834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 179/351] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:11.099006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.130978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f869e-5f40-4f7d-851a-5afa37f4ef55 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.169196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.170359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.170868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.171369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.172454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:11.173929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.175631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.185359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 173/352] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.186666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.206539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfc89b-7940-4b8f-ae8e-8322832c8453 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.242505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.243669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.244204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.244672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.251299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.252996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.255238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 180/353] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.256232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.305010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.314955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508aec-dce7-4d3e-a6df-464dfc418ebd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.328287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.363964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.364642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.364923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.365200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.366229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:11.366549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.367896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.375135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc04b21-3d67-45d5-9b43-5bd59e80a810 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.378096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 174/354] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.378765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.422539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.423205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.423470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.423747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.425368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.426924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.430262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 181/355] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.430262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.524459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8418a-871c-4a22-8381-03d7dc395cb2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.556003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b9d2-c857-4678-aec8-2a55c222cf5d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.566511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795ca7c-1378-4c46-902e-abbab2cd4e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.567660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795ca7c-1378-4c46-902e-abbab2cd4e15 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.569007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795ca7c-1378-4c46-902e-abbab2cd4e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.569502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795ca7c-1378-4c46-902e-abbab2cd4e15 None admin] PATH_INFO: `/v3/users/01481939805d457fa7a25cbb7d8b168f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.572202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795ca7c-1378-4c46-902e-abbab2cd4e15 None admin] RBAC: Authorizing `identity:get_user(user_id=01481939805d457fa7a25cbb7d8b168f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.577083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795ca7c-1378-4c46-902e-abbab2cd4e15 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.577083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 175/356] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/users/01481939805d457fa7a25cbb7d8b168f => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.577263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d32c9-453a-4c25-b04a-bbfa12607907 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.577546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d32c9-453a-4c25-b04a-bbfa12607907 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.577812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d32c9-453a-4c25-b04a-bbfa12607907 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.581534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.583058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 176/357] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:11.583893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d32c9-453a-4c25-b04a-bbfa12607907 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.617867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.618567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.618852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.619129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.619971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=e0764a20fd3346b99be74625b068a5d4) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:11.620287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.621731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.635816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 182/358] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=f60d92c63c684ab6b89b982e4049558a => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.635816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.657524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.754170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d32c9-453a-4c25-b04a-bbfa12607907 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.787006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffbfe4-2146-472c-9483-179a746538ba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:11.810286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a874bdc-f086-4e4a-9262-d68655d0cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.811394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874bdc-f086-4e4a-9262-d68655d0cf2a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.811686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874bdc-f086-4e4a-9262-d68655d0cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.812020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a874bdc-f086-4e4a-9262-d68655d0cf2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.832794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:11.833985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:11.834104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:11.834364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:11.835615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.837142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.838948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 183/359] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:11.839711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:11.906016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.908521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a874bdc-f086-4e4a-9262-d68655d0cf2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:11.910112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a874bdc-f086-4e4a-9262-d68655d0cf2a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:11.963131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.972887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee6596-842b-407f-9af0-e822cc32073f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.021605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.022681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.023168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.023645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.025239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] RBAC: Adding query filter params (role.id=bd66dea4a80644bdb90f1f0208ea11de, user.id=01481939805d457fa7a25cbb7d8b168f, scope.system=all) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:12.025630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:12.027203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772279d9-f8d4-4633-a0af-6f945d118934 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:12.043495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 184/360] 10.222.0.16 () {56 vars in 1308 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/role_assignments?user.id=01481939805d457fa7a25cbb7d8b168f&scope.system=all&role.id=bd66dea4a80644bdb90f1f0208ea11de => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:12.045181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.046080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.046666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.054387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 177/361] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:12.056006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884579ce-7805-4aa0-8ca2-e687252957f0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.056371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884579ce-7805-4aa0-8ca2-e687252957f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.056718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884579ce-7805-4aa0-8ca2-e687252957f0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.058571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 178/362] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:12.059508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884579ce-7805-4aa0-8ca2-e687252957f0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.069896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:12.071198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:12.159691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 185/363] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:12.161816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.196758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884579ce-7805-4aa0-8ca2-e687252957f0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.203586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:12.239619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.240863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.241313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.241719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.242856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=e0764a20fd3346b99be74625b068a5d4) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:12.243407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:12.245039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb6576-cf4e-4325-9357-4ae3809be719 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:12.252206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 179/364] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:12.253649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.254072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.254503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.276538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:12.286927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:12.289145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:12.300061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7aba12-dd74-4642-bb03-f5d9fca729a3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.350649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.352752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.354123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.354742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.357704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:12.360389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:12.364194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 186/365] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:12.365445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.386486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 180/366] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:12.388591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.494523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f75eb-21cd-4a38-a411-c3fce98f27f9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.497738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:12.533976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8195a3-8225-4000-b663-44d017247d93 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.537769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.539149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.539436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.539721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.552447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:12.562567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:12.563875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:12.564732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:12.567907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 187/367] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:12.569122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.580647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.581612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.581895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.582168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.584165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:12.585616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:12.587646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 181/368] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:12.588415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.622955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:12.696341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cefec-fc07-4aee-9289-0ed0b2233a6c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.709327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da96ec-9d38-4cd1-99eb-201ddc2997b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.734042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.735212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.735710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.736729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.749043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:12.749189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.749424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.749614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.749891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.750682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:12.750989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:12.752909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:12.759260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:12.760147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:12.760949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:12.762008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 182/369] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:12.763677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.763886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 188/370] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:12.766758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:12.794268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:12.838029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:12.879280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469d5c3-c067-46b0-abe4-f255c38be59a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.880566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c1c7-3211-47da-935e-1a90a59b18c8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:12.916413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.917456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.917957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.918450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:12.918682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.919099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:12.919387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:12.919668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:12.920343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=abfde98cb32b430f8d245d455a20a188) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:12.920848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:12.922490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:12.930462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 183/371] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=f60d92c63c684ab6b89b982e4049558a => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:12.933811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:13.013135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:13.015099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:13.044110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:13.135922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 189/372] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:13.146552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:13.188202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056d91-8ab2-4377-a83d-e46f6c7e8052 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:13.239938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:13.264491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f56a1c-cc9e-4bcd-9007-a567178f1441 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:13.270937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:13.271639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:13.271918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:13.272196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:13.272960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:13.273266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:13.274666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:13.296358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 184/373] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:13.301553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:13.302453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:13.302881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:13.303225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:13.303691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:13.304637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:13.306157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:13.308266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 190/374] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:13 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:13.310438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:13.315715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:13.433493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bee5d-7a3d-43b0-adfe-c6bb3c383f9f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:13.473761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:13.474905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:13.475173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:13.475436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:13.476908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:13.478401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:13.480840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 191/375] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:13 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:13.486717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:13.507294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c182-98e3-4fc4-bb23-613be5bd5b4f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:13.573861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:13.577665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:13.578379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:13.578668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:13.578946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:13.652378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e811e-7775-461f-8924-320a86247dbf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:13.683143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:13.695650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:13.696316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:13.696601 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:13.696882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:13.697831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=abfde98cb32b430f8d245d455a20a188) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:13.698148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:13.700913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:13.701991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:13.702455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:13.709283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 192/376] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:13 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:13.827571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 185/377] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:13.833030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:13.956965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a8a56-14e9-482d-8b3a-d36997433065 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:13.982882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:13.996950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:13.997835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:13.998120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:13.998425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] PATH_INFO: `/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:13.999666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c438c1ae4c4814acf705cd2b5ad9d9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:14.001121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:14.003296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 193/378] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:13 2022] GET /identity/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:14.011374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:14.117417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:14.129709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61167ee-fcea-435a-a581-226309bfda65 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:14.172332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952edae-6bcd-4425-8444-e3a6c51f5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:14.173775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952edae-6bcd-4425-8444-e3a6c51f5157 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.174067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952edae-6bcd-4425-8444-e3a6c51f5157 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.174366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952edae-6bcd-4425-8444-e3a6c51f5157 None admin] PATH_INFO: `/v3/groups/82546f2232934a7aae52d77a17a066e9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.184662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952edae-6bcd-4425-8444-e3a6c51f5157 None admin] RBAC: Authorizing `identity:get_group(group_id=82546f2232934a7aae52d77a17a066e9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:14.186112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952edae-6bcd-4425-8444-e3a6c51f5157 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:14.188209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 186/379] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:14 2022] GET /identity/v3/groups/82546f2232934a7aae52d77a17a066e9 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:14.194189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:14.206394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf1625-c5f1-417e-95cc-9208e7fe527f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.206681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf1625-c5f1-417e-95cc-9208e7fe527f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.206946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf1625-c5f1-417e-95cc-9208e7fe527f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.212889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 187/380] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:14.214735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.215024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.215304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.252637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:14.256528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:14.346590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cfd25-dafa-4cb5-93d1-bf25393f2cf0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:14.386300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:14.386891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.387175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.387455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.388299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] RBAC: Adding query filter params (group.id=82546f2232934a7aae52d77a17a066e9, role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=a2c438c1ae4c4814acf705cd2b5ad9d9) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:14.388607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:14.390041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:14.397071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 194/381] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:14 2022] GET /identity/v3/role_assignments?group.id=82546f2232934a7aae52d77a17a066e9&scope.project.id=a2c438c1ae4c4814acf705cd2b5ad9d9&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:14.400542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 188/382] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:14.427610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:14.497015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:14.550939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ecc88-42de-4d3b-ae70-78fa58849fd1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:14.592612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:14.593443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.593737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.594012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.606375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:14.614784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:14.617050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:14.618950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:14.625935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:14.741747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:14.757862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86b691-90c8-453c-9214-ec85971e89cb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:14.791811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:14.792484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.792760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.793034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.793783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:14.794083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:14.795479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:14.805093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 189/384] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:14.810600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:14.935798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c8703-ed20-4e75-8997-cb316611bbc1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:14.950829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:14.976185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:14.977057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:14.977342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:14.977621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:14.978881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:14.980348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:14.983257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 196/385] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:14 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:14.988329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:15.121043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84b3c-b589-4ae6-9ff4-e51dc11070fb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:15.157179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76db6f-bae0-4b9e-964e-ef4afbf6f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:15.158613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76db6f-bae0-4b9e-964e-ef4afbf6f6cc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.158895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76db6f-bae0-4b9e-964e-ef4afbf6f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.159168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76db6f-bae0-4b9e-964e-ef4afbf6f6cc None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.160374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76db6f-bae0-4b9e-964e-ef4afbf6f6cc None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:15.161787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76db6f-bae0-4b9e-964e-ef4afbf6f6cc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:15.163806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:14 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:15.169175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:15.295271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154a55-a198-4cd6-8afa-c6770cf0be84 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:15.337647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23b04-ad06-442a-9ce9-deef5dbe34bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:15.338575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23b04-ad06-442a-9ce9-deef5dbe34bc None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.338862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23b04-ad06-442a-9ce9-deef5dbe34bc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.339140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23b04-ad06-442a-9ce9-deef5dbe34bc None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4/groups/8ea0dd17d732423888bc66e684ad57ed/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.341147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23b04-ad06-442a-9ce9-deef5dbe34bc None admin] RBAC: Authorizing `identity:create_grant(project_id=e0764a20fd3346b99be74625b068a5d4, group_id=8ea0dd17d732423888bc66e684ad57ed, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:15.342615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23b04-ad06-442a-9ce9-deef5dbe34bc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:15.367418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 08:57:15 2022] PUT /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4/groups/8ea0dd17d732423888bc66e684ad57ed/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:15.386687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fdfb-b2b2-435b-8709-02bdba6cf1b2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.386998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fdfb-b2b2-435b-8709-02bdba6cf1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.387244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0fdfb-b2b2-435b-8709-02bdba6cf1b2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.388918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 191/388] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:15.395248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.395566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.395813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.414206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:15.415530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:15.462326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:15.508276 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 198/389] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:15.547396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1498-733c-41c5-a138-d7adcdea93fd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.547687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1498-733c-41c5-a138-d7adcdea93fd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.547874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc1498-733c-41c5-a138-d7adcdea93fd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.547970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:15.549579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 192/390] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:15.562798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.563104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.563346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.596679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:15.597934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:15.616189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:15.686620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 193/391] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:15.689119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5153cf-5e04-437d-b28d-a981e9a93e62 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:15.711477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:15.729199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:15.730021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.730393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.730676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.743949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:15.752242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:15.753152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:15.753934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 199/392] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:15.762086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:15.809207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:15.826252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9811f0-c2bf-4afe-af33-ea11c5d23b8b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:15.862549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:15.863355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:15.863638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:15.863912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:15.875184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:15.883821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:15.884756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:15.885577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 194/393] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:15.893196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:15.906603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:15.968267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d32c68f-ca93-4d68-9d3a-48fe7182ea62 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.009246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8439-0e81-4f7e-9af0-673a1dcaf95a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.054248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.054248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.054248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.054248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.054680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:16.054680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.054680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.057281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.058200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.058725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.059274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.060738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:16.061263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.063225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.070246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 200/394] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:16.070740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.083678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 195/395] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:16.084986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.178603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:16.228855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07a189-e4ee-41f3-ab65-1ec5b242cb32 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.239464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:16.247272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfdc2f-144b-44d1-9e10-7d5cc0a9296d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.271332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.272309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.272596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.272873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.275194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.276644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.278771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 196/396] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:16 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:16.288140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.361325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.362207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.362514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.362790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.363991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.365440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.367635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 201/397] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:16 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:16.373464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.402438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4c85-be68-4e18-97f8-f6d2ae4f389f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.446831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.447711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.447992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.448268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.450970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.452463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.456427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 197/398] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:16 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:16.465067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.474587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:16.533728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37298972-d6d3-44e6-92c2-ca907efb4e5e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.570741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.571610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.571896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.572174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.583161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.584964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.587043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 202/399] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:16 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:16.592878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.594266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf95fe8-d135-4463-b491-d31eeee4b3a8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.632236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ddf89-e272-46ff-bb51-78a5874fed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.633371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ddf89-e272-46ff-bb51-78a5874fed42 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.633694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ddf89-e272-46ff-bb51-78a5874fed42 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.633979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ddf89-e272-46ff-bb51-78a5874fed42 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188/groups/8ea0dd17d732423888bc66e684ad57ed/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.636112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ddf89-e272-46ff-bb51-78a5874fed42 None admin] RBAC: Authorizing `identity:create_grant(project_id=abfde98cb32b430f8d245d455a20a188, group_id=8ea0dd17d732423888bc66e684ad57ed, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.637835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ddf89-e272-46ff-bb51-78a5874fed42 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.655124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:16.657456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 198/400] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 08:57:16 2022] PUT /identity/v3/projects/abfde98cb32b430f8d245d455a20a188/groups/8ea0dd17d732423888bc66e684ad57ed/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:16.659658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b659df-8762-40f0-ba1a-e4e5f205f860 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.660572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b659df-8762-40f0-ba1a-e4e5f205f860 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.661076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b659df-8762-40f0-ba1a-e4e5f205f860 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.663376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 199/401] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:16.669298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.669926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.670449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.690152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:16.692322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:16.747393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db1fd4-b170-4ea1-80a1-613ff0101c1b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.763615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:16.774008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 200/402] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:16.788039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.788937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.789219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.789552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4/groups/8ea0dd17d732423888bc66e684ad57ed/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:16.791989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e0764a20fd3346b99be74625b068a5d4, group_id=8ea0dd17d732423888bc66e684ad57ed, role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:16.793841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:16.803907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:16.812497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 203/403] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 08:57:16 2022] PUT /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4/groups/8ea0dd17d732423888bc66e684ad57ed/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:16.950820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b8da2-4d7e-40d9-aebd-aef4c5bf495f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:16.993988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c00bf1-d2c0-4d93-abfb-b40603f4c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:16.994847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c00bf1-d2c0-4d93-abfb-b40603f4c233 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:16.995127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c00bf1-d2c0-4d93-abfb-b40603f4c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:16.995400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c00bf1-d2c0-4d93-abfb-b40603f4c233 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.017676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c00bf1-d2c0-4d93-abfb-b40603f4c233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-69c00bf1-d2c0-4d93-abfb-b40603f4c233 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:17.023676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:17.024603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:17.025444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 201/404] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:17.031528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:17.090373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de1540-e8b6-45e2-871b-05242527f186 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.090717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de1540-e8b6-45e2-871b-05242527f186 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.090941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de1540-e8b6-45e2-871b-05242527f186 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.093862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 202/405] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:57:17.097833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.098125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.098444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.126179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:17.127976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:17.140041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:17.151257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9508921-8f60-4996-922e-ddd224a689f5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:17.191241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:17.192258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.192815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.193275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.194235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:17.194860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:17.196589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:17.208444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 204/406] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:17.214336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:17.223469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:17.244923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 203/407] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:17.279593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:17.341196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03726b81-2690-44b9-b33c-c6924ec7f5e7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:17.383570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:17.384757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.385199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.385686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.387587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:17.389383 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:17.391885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 205/408] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:17 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:17.397287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:17.430578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:17.507999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c956-a1d7-4944-ae1a-58496c6c1a3d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:17.515595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb95722-cfb6-478a-bfad-3c01df31841a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:17.551262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:17.552144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.552432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.552709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.553911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:17.555377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:17.557499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:17 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:17.562790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:17.623786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:17.624828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.625247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.625677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.654854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:17.662720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:17.663830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:17.664815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:17.667055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:17.673771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:17.697110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:17.718504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260d641-247f-42d5-b673-1f556fbdfc35 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:17.760547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:17.776487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:17.777378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.777658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.777935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188/groups/8ea0dd17d732423888bc66e684ad57ed/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.782498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] RBAC: Authorizing `identity:create_grant(project_id=abfde98cb32b430f8d245d455a20a188, group_id=8ea0dd17d732423888bc66e684ad57ed, role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:17.784515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:17.808777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 207/411] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 08:57:17 2022] PUT /identity/v3/projects/abfde98cb32b430f8d245d455a20a188/groups/8ea0dd17d732423888bc66e684ad57ed/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:17.871166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77088b-300d-407c-888b-baefe2f42847 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:17.915803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:17.916533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:17.916827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:17.917108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:17.917870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:17.918182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:17.919601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:17.933360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 205/412] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:17.938870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:18.084658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec3933-2807-4b96-b306-387db0db8174 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:18.121960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:18.122912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:18.123202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:18.123484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] PATH_INFO: `/v3/groups/82546f2232934a7aae52d77a17a066e9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:18.124741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] RBAC: Authorizing `identity:get_group(group_id=82546f2232934a7aae52d77a17a066e9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:18.126179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:18.128159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 208/413] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:17 2022] GET /identity/v3/groups/82546f2232934a7aae52d77a17a066e9 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:18.135358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:18.281660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edd255-c02d-45c0-9ea4-f0377018ed53 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:18.289260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:18.326931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6340109-a7d8-4a1b-94f2-404ee8ce2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:18.327860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340109-a7d8-4a1b-94f2-404ee8ce2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:18.328146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340109-a7d8-4a1b-94f2-404ee8ce2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:18.328417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340109-a7d8-4a1b-94f2-404ee8ce2da6 None admin] PATH_INFO: `/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:18.330249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6340109-a7d8-4a1b-94f2-404ee8ce2da6 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c438c1ae4c4814acf705cd2b5ad9d9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:18.331685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6340109-a7d8-4a1b-94f2-404ee8ce2da6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:18.333598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 206/414] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:18 2022] GET /identity/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:18.339281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:18.387994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:18.474969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdb8c-0427-4b2f-b497-cef798cc4d60 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:18.475311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdb8c-0427-4b2f-b497-cef798cc4d60 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:18.475543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdb8c-0427-4b2f-b497-cef798cc4d60 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:18.477164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 207/415] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:57:18.481906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:18.482196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:18.482512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:18.491515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b72756-a944-4c3f-b8f7-11932e25229f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:18.499879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:18.501117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:18.533726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:18.534985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:18.535639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:18.536135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] PATH_INFO: `/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9/groups/82546f2232934a7aae52d77a17a066e9/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:18.539061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] RBAC: Authorizing `identity:create_grant(project_id=a2c438c1ae4c4814acf705cd2b5ad9d9, group_id=82546f2232934a7aae52d77a17a066e9, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:18.540796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:18.559324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 209/416] 10.222.0.16 () {58 vars in 1442 bytes} [Fri Jun 24 08:57:18 2022] PUT /identity/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9/groups/82546f2232934a7aae52d77a17a066e9/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:18.605797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 208/417] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:18.645922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:18.740337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:18.764039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a2e8a-d466-4aa0-837c-2a6c9b33d2de None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:18.799390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:18.800147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:18.800386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:18.800658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:18.811311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:18.820178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:18.821044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:18.821866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 210/418] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:18.827112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:18.959164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a3725-9930-4185-8000-da0c5f5b9d24 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:18.961521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:18.999081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:18.999761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.000047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.000334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.001092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:19.001435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:19.006940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754c3c0-5052-4bcf-b8f2-488ecfa743d0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:19.015588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 209/419] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:19.023502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.156596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f9bc-7308-4c18-b9e0-be6608b3cc53 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:19.197221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54359824-91b9-49d9-a506-d61a1e44b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:19.197872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54359824-91b9-49d9-a506-d61a1e44b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.198156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54359824-91b9-49d9-a506-d61a1e44b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.198463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54359824-91b9-49d9-a506-d61a1e44b7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.202032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:19.253281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3ba5f-aeec-486e-b0a7-dde05037aa84 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.253760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3ba5f-aeec-486e-b0a7-dde05037aa84 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.254134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3ba5f-aeec-486e-b0a7-dde05037aa84 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.256041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 210/420] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:19.261036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.261424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.261820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.279207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:19.280516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:19.284855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54359824-91b9-49d9-a506-d61a1e44b7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:19.286346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54359824-91b9-49d9-a506-d61a1e44b7e8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:19.375151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 211/421] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:57:19.399761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.476585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 211/422] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:19.477863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf608a4-dc17-402e-9aa8-ac9582e1a7f5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.478159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf608a4-dc17-402e-9aa8-ac9582e1a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.478467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf608a4-dc17-402e-9aa8-ac9582e1a7f5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.479989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 212/423] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:19.487054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf608a4-dc17-402e-9aa8-ac9582e1a7f5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.528128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87159b11-0204-44ee-9015-8c36ff8158c7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:19.530763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:19.550634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:19.576258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1f83d-429d-43cf-b0cf-234bdd0e12b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:19.577854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1f83d-429d-43cf-b0cf-234bdd0e12b0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.578378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1f83d-429d-43cf-b0cf-234bdd0e12b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.578903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1f83d-429d-43cf-b0cf-234bdd0e12b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.593945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1f83d-429d-43cf-b0cf-234bdd0e12b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:19.603300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf608a4-dc17-402e-9aa8-ac9582e1a7f5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-06f1f83d-429d-43cf-b0cf-234bdd0e12b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:19.605166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:19.606044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:19.606897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:19.610174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 212/424] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:19.611616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.612080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.612528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.633721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:19.635658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:19.643453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:19.644401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.644752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.645097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.646831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:19.648495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:19.654995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 213/425] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:19.655962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.722542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 213/426] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:19.723617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.781562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8fb9d-fb85-4b82-8c4a-6402e9a59da1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:19.783828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:19.818689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:19.819457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.819659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.819981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.820894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:19.821249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:19.822948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:19.832850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 214/427] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:19.833801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.848326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:19.869296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1345cdd-a840-48d2-b7e4-c05ffe70c90c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:19.913662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:19.914874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.915354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.915801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:19.917602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:19.919621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:19.922081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 214/428] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:19.923078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:19.949083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0c083-7173-4ecc-aa0f-3b32f8ea4bcc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:19.995019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:19.996337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:19.997086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:19.997794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.011436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:20.025326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:20.026285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:57:20.027087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:20.037464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 215/429] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:20.037464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.053223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488033e-c0a6-4e81-acdb-26af4a8c9a02 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.063108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.101552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.102601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.103051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.103718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.134576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.153715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099206-09f7-44ff-87a0-7ed341b035cb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.192972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.195112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.197382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.198133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.199028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.199028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.199819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=e0764a20fd3346b99be74625b068a5d4) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:20.200230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.201733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.208807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 216/430] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=f60d92c63c684ab6b89b982e4049558a => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:20.209902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.350983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 215/431] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:20.355722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.356607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.368198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94819707-64fc-4613-b684-2ba77a9c5ef4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.409976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.410674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.413717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.414006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.414849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:20.415157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.416533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.426287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 217/432] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:20.431539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.455596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.515681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537d513-1289-4445-b812-6b65ecf12d45 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.561026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ffdf5-55cc-4386-bef1-b3f74ef33cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.561889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ffdf5-55cc-4386-bef1-b3f74ef33cfc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.562174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ffdf5-55cc-4386-bef1-b3f74ef33cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.562480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ffdf5-55cc-4386-bef1-b3f74ef33cfc None admin] PATH_INFO: `/v3/projects/e0764a20fd3346b99be74625b068a5d4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.564213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ffdf5-55cc-4386-bef1-b3f74ef33cfc None admin] RBAC: Authorizing `identity:get_project(project_id=e0764a20fd3346b99be74625b068a5d4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.564850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318d5b0-8605-4393-ac03-62771d6c12d8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.565663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ffdf5-55cc-4386-bef1-b3f74ef33cfc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.568355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 216/433] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/projects/e0764a20fd3346b99be74625b068a5d4 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:20.569643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409919-1b9b-4534-9265-5dc324ed8f74 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.569929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409919-1b9b-4534-9265-5dc324ed8f74 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.570208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409919-1b9b-4534-9265-5dc324ed8f74 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.571624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 217/434] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:20.576235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409919-1b9b-4534-9265-5dc324ed8f74 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.605545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.606137 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.606475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.606758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.633757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.699973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.701892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.711758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409919-1b9b-4534-9265-5dc324ed8f74 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.741422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.760927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d4895-86af-460b-a8da-3edbf020f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.761784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4895-86af-460b-a8da-3edbf020f5bd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.762082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4895-86af-460b-a8da-3edbf020f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.762369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d4895-86af-460b-a8da-3edbf020f5bd None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.763547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d4895-86af-460b-a8da-3edbf020f5bd None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.764997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d4895-86af-460b-a8da-3edbf020f5bd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.766656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 218/435] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:20.766656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.766656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.766656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.786251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:20.787458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:20.828498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 218/436] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:20.829172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.862247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 219/437] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:20.867124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.883622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:20.933061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc0383-c331-4aec-a972-9502ec9c35e9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:20.966723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:20.967381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:20.967667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:20.967947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:20.968776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=e0764a20fd3346b99be74625b068a5d4) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:20.969091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:20.971156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:20.976815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 219/438] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=e0764a20fd3346b99be74625b068a5d4&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:20.977582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:20.978094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c604-5fd5-4060-827b-f01c2b973ce5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.007166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.032177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ba79f-1940-4336-981c-a414789122be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.034030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba79f-1940-4336-981c-a414789122be None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.034506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba79f-1940-4336-981c-a414789122be None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.034864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ba79f-1940-4336-981c-a414789122be None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.036193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ba79f-1940-4336-981c-a414789122be None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.037655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ba79f-1940-4336-981c-a414789122be None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.039782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 220/439] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:21.041087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7acf-9929-4e46-bc54-4479a6bc0080 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.041374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7acf-9929-4e46-bc54-4479a6bc0080 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.041654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d7acf-9929-4e46-bc54-4479a6bc0080 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.047249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 221/440] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:21.047249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7acf-9929-4e46-bc54-4479a6bc0080 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.105938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38098a-0e9d-4fc2-b0d6-76bc2f863941 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.124433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.153129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779069-d365-43aa-a099-1e491e240a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.153949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779069-d365-43aa-a099-1e491e240a9d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.154252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779069-d365-43aa-a099-1e491e240a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.155152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779069-d365-43aa-a099-1e491e240a9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.166412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba779069-d365-43aa-a099-1e491e240a9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:21.167342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d7acf-9929-4e46-bc54-4479a6bc0080 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ba779069-d365-43aa-a099-1e491e240a9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:21.175170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:21.176083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:21.176961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 220/441] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:21.178314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.178314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.178556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.200470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:21.203182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:21.214297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.215156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.215434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.216163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.216971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.218420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.220727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 222/442] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:21.221395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.284588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 221/443] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:21.285444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.300669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.359011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6cf0f-cead-46c9-83ea-05f4d6e2dbe8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.393393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.393986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.394291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.394570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.395322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:21.395630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.396988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.397481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998750-cfa0-49df-b380-111e42d1a352 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.404627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.404900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 223/444] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:21.405685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.436301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.436959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.437247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.437529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.438396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=f60d92c63c684ab6b89b982e4049558a, scope.project.id=abfde98cb32b430f8d245d455a20a188) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:21.438744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.440163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.446064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 222/445] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=f60d92c63c684ab6b89b982e4049558a => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:21.446687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.522739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacd5a0-c4ba-444b-b2c9-e45212622ed9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.542138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.563503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.564792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.565072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.565570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.568252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23000c-1615-42b7-b9be-89b22ae9553c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.577058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:21.585248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:21.586269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:21.587108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 224/446] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:21.592469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.609455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.610110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.613517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.613517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.656111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.692419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.693918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.721622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5257-664c-4acb-864c-e7e0a98501de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.759902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ec028-110f-4270-a861-07846170056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.760826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ec028-110f-4270-a861-07846170056a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.761322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ec028-110f-4270-a861-07846170056a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.761786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ec028-110f-4270-a861-07846170056a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.762762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ec028-110f-4270-a861-07846170056a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:21.763072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ec028-110f-4270-a861-07846170056a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.764433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ec028-110f-4270-a861-07846170056a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.774255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 225/447] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:21.779666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ec028-110f-4270-a861-07846170056a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.813584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 223/448] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:21.819732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.825642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.884989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ec028-110f-4270-a861-07846170056a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.891345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:21.919292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.919873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.920160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.920439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.922855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637862a-0dd4-486f-a366-3cdd732bd663 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:21.956691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01660-5309-4494-b497-72f69296f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:21.957553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01660-5309-4494-b497-72f69296f76c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:21.957832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01660-5309-4494-b497-72f69296f76c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:21.958101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01660-5309-4494-b497-72f69296f76c None admin] PATH_INFO: `/v3/projects/abfde98cb32b430f8d245d455a20a188` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:21.959312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01660-5309-4494-b497-72f69296f76c None admin] RBAC: Authorizing `identity:get_project(project_id=abfde98cb32b430f8d245d455a20a188)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.960753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01660-5309-4494-b497-72f69296f76c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:21.962446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 224/449] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/projects/abfde98cb32b430f8d245d455a20a188 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:21.967928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01660-5309-4494-b497-72f69296f76c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:21.987829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:21.989254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:22.029873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:22.074194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01660-5309-4494-b497-72f69296f76c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:22.087659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 226/450] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:22.093138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:22.107532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:22.108399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:22.108682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:22.108959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] PATH_INFO: `/v3/groups/8ea0dd17d732423888bc66e684ad57ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:22.110157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] RBAC: Authorizing `identity:get_group(group_id=8ea0dd17d732423888bc66e684ad57ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:22.112191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:22.113801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 225/451] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:21 2022] GET /identity/v3/groups/8ea0dd17d732423888bc66e684ad57ed => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:22.119657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:22.127635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:22.191942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f279764-3fe4-4d95-8030-bc266f11dd08 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:22.216430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ad2f2-d682-469f-a6c1-b03aa0f941c5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:22.225488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:22.226367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:22.226650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:22.226926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] PATH_INFO: `/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:22.228113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=a2c438c1ae4c4814acf705cd2b5ad9d9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:22.229536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:22.231250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 227/452] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:57:22 2022] GET /identity/v3/projects/a2c438c1ae4c4814acf705cd2b5ad9d9 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:22.236518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:22.246762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:22.250857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:22.251539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:22.251824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:22.252111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:22.252941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] RBAC: Adding query filter params (group.id=8ea0dd17d732423888bc66e684ad57ed, role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=abfde98cb32b430f8d245d455a20a188) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:22.253257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:22.254686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:22.260484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 226/453] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:22 2022] GET /identity/v3/role_assignments?group.id=8ea0dd17d732423888bc66e684ad57ed&scope.project.id=abfde98cb32b430f8d245d455a20a188&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:22.340645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae81af-ed62-40af-a186-2b4755f43fb2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:22.376165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cbad9-7481-4dbb-a62f-eb6ded0d2cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:22.377022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cbad9-7481-4dbb-a62f-eb6ded0d2cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:22.377301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cbad9-7481-4dbb-a62f-eb6ded0d2cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:22.377575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cbad9-7481-4dbb-a62f-eb6ded0d2cc3 None admin] PATH_INFO: `/v3/groups/82546f2232934a7aae52d77a17a066e9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:22.378781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cbad9-7481-4dbb-a62f-eb6ded0d2cc3 None admin] RBAC: Authorizing `identity:get_group(group_id=82546f2232934a7aae52d77a17a066e9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:22.380242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cbad9-7481-4dbb-a62f-eb6ded0d2cc3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:22.381898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 228/454] 10.222.0.16 () {56 vars in 1180 bytes} [Fri Jun 24 08:57:22 2022] GET /identity/v3/groups/82546f2232934a7aae52d77a17a066e9 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:22.387965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:22.457916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:22.489562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aca7f-9552-4767-a040-ae97004c8a8e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:22.523528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:22.524181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:22.524467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:22.524736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:22.525564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] RBAC: Adding query filter params (group.id=82546f2232934a7aae52d77a17a066e9, role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=a2c438c1ae4c4814acf705cd2b5ad9d9) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:22.525869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:22.527314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a24097-0549-4278-a5ab-cf92072585ad None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:22.533745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 227/455] 10.222.0.16 () {56 vars in 1376 bytes} [Fri Jun 24 08:57:22 2022] GET /identity/v3/role_assignments?group.id=82546f2232934a7aae52d77a17a066e9&scope.project.id=a2c438c1ae4c4814acf705cd2b5ad9d9&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:24.999858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073d4e-bd74-4ab9-a41f-467bed36fc20 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.000819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073d4e-bd74-4ab9-a41f-467bed36fc20 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.001859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e073d4e-bd74-4ab9-a41f-467bed36fc20 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.003862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 229/456] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:25.009557 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535b3c-a19f-4da2-8101-d82ac04e66d2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.010422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535b3c-a19f-4da2-8101-d82ac04e66d2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.010900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535b3c-a19f-4da2-8101-d82ac04e66d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.038444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5c535b3c-a19f-4da2-8101-d82ac04e66d2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:25.039636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5c535b3c-a19f-4da2-8101-d82ac04e66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:25.136515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 228/457] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:25.138722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19c7a3-885a-466d-8ab5-ae34bcf547a7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.139200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19c7a3-885a-466d-8ab5-ae34bcf547a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.139615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19c7a3-885a-466d-8ab5-ae34bcf547a7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.142906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 230/458] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:25.147128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.147421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.147703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.174652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:25.175851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:25.184905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19c7a3-885a-466d-8ab5-ae34bcf547a7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:25.286311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:25.293515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 229/459] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:25.314640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:25.339620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:25.348368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19c7a3-885a-466d-8ab5-ae34bcf547a7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:25.416869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:25.417669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.417940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.418208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.439946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:25.441472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:25.474067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:25.475031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:25.475900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:25.475900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:25.475900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:25.475900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:25.484464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 231/460] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:25.485331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:25.528309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2213eee6-44e9-4af1-8ce0-152020233aef None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:25.581314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:25.582028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.582333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.582613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.592789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:25.594275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:25.611433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312653f3-9f77-42c1-b0a1-cd7999367a20 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3da96a52-8434-458e-8e8b-f97d835fc976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:25.613592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:25.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:25.615515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:25.615515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:25.615515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:25.615515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:25.615515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 230/461] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:25.617078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e517e-b529-4c90-adfa-749a1250fb00 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.617078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e517e-b529-4c90-adfa-749a1250fb00 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.617078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e517e-b529-4c90-adfa-749a1250fb00 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.618079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 231/462] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:25.619142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4378-7ff3-4f65-a58a-2ea51fd968d3 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.619423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4378-7ff3-4f65-a58a-2ea51fd968d3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.619701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4378-7ff3-4f65-a58a-2ea51fd968d3 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.620999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 232/463] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:25.621544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4378-7ff3-4f65-a58a-2ea51fd968d3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:25.652133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:25.660890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:25.661548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.662482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.662482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.662833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:25.663134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:25.664496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61764317-53f7-49eb-9388-f33b96a006d8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:25.676191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:25.682949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 232/464] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:25.684254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c047eb2-0440-451f-b8cc-a3703197ac6a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.684540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c047eb2-0440-451f-b8cc-a3703197ac6a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.684814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c047eb2-0440-451f-b8cc-a3703197ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.702030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6c047eb2-0440-451f-b8cc-a3703197ac6a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:25.703176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c047eb2-0440-451f-b8cc-a3703197ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:25.741902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4378-7ff3-4f65-a58a-2ea51fd968d3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:25.782246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 233/465] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:25.782246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.782246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.782246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.785837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:25.786669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.786956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.787427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.788151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:25.788511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:25.789927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:25.799806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:25.800993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:25.802077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 233/466] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:25.803002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:25.877454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 234/467] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:25.878534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:25.909711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed566a-3cf4-4965-824b-b4c810741d32 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:25.917309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:25.947174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:25.947856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:25.948143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:25.948409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:25.949105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:25.950570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:25.952421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:25.971627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 234/468] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:25 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:25.972686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.041313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdce490-92c5-4a99-9112-5b48cfe677da None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.083281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.084448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.084926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.085399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.097919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.099788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.112863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649fd05-d2f8-493e-b4b7-7fd6a08b8c95 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:26.120245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:26.121183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:26.122094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:26.122094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:26.122094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:26.122094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.124442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 235/469] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:26.125628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.156857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.157170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.157943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.158263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.158953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.160388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.180655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 235/470] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:25 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:26.181652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.203018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:26.262866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:26.265904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf50d2-5c1d-4dc8-ba29-6082cf6bcf55 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.310416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4dbd-1650-469a-bade-c6d54c0442b7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.318548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.319358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.320268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.320561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.337908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.339985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.353259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.353939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.354243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.354540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.355287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:26.355594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.357011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:26.366391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:26.367311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:26.368199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:26.368199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:26.368199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:26.368199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.368831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 236/471] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:26.372705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 236/472] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:26.374599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.378519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.461995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:26.490249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468946-0385-4236-a9d4-3d5a1b3ed82e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.506418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eccd6-3ba1-4289-9ebd-b3d7b84be1cd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.535933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.536917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.537465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.537746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.538635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.540662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.544344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.545007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.545287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.545560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.546316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:26.546622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.548784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3cee-e2c8-4ef7-b026-f28c69ff1034 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.563733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 237/473] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:26.565927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 237/474] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:26 2022] POST /identity/v3/users => generated 248 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:57:26.571003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c18d-7e8a-47b1-b1aa-5f1363bf7804 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.571241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.571343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c18d-7e8a-47b1-b1aa-5f1363bf7804 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.571646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c18d-7e8a-47b1-b1aa-5f1363bf7804 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.576949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 238/475] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:26.578517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.578800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.579133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.609381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:26.612244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:26.623336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:26.733596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d01a32-1a3f-4119-8388-2114de4a1264 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.755780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 239/476] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:26.788703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:26.789472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.790166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.790494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.790770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.791482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.792915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.802164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:26.823723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 238/477] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:26 2022] POST /identity/v3/users => generated 249 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:26.910263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788f0ad-eee5-4ee1-b12b-fea3ece5d061 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:26.952353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:26.953050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:26.953333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:26.953611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:26.954952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:26.956350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:26.965967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.sql.core [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 08:57:26.965967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 08:57:26.965967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [parameters: {'id': 'bbf6bc92a3874303956a4658733b9e29', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 08:57:26.965967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80253) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Jun 24 08:57:26.984143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:57:26.985055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application yield resource Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise self.value Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application session.commit() Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:57:26.986014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:57:26.986944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:57:26.987876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:57:26.988783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [parameters: {'id': 'bbf6bc92a3874303956a4658733b9e29', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:26.989607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 08:57:26.993031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:26.995182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 240/478] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 08:57:26 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:26.995321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:27.121299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befc46f-69c1-443e-8f15-edbb98b2a81f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:27.160353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e0bdc-13c2-4f37-92a8-7e5d584a5d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:27.161235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e0bdc-13c2-4f37-92a8-7e5d584a5d68 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:27.161519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e0bdc-13c2-4f37-92a8-7e5d584a5d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:27.161845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e0bdc-13c2-4f37-92a8-7e5d584a5d68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:27.172972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e0bdc-13c2-4f37-92a8-7e5d584a5d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-035e0bdc-13c2-4f37-92a8-7e5d584a5d68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:27.181069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:27.183015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:27.183966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:57:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:27.187865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:27.198954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:27.293295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c08b-ed4d-493f-a81d-6cd416d8e87d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:27.330839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:27.331505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:27.331785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:27.332058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:27.332801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:27.333102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:27.338519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b6815-dece-4bcb-a640-0561ce0afb36 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:27.347449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 241/480] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:28.690125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dd37e-1b47-4a91-8f18-50978f19ed42 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:28.690125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dd37e-1b47-4a91-8f18-50978f19ed42 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:28.690125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dd37e-1b47-4a91-8f18-50978f19ed42 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:28.691392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 240/481] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:28.698891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:28.699430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:28.699430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:28.703736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ca962-aaae-4c48-a0aa-3f4a4f522e3c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:28.704029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ca962-aaae-4c48-a0aa-3f4a4f522e3c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:28.704903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ca962-aaae-4c48-a0aa-3f4a4f522e3c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:28.706496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 241/482] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:57:28.711440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:28.711720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:28.712000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:28.725132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:28.726658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:28.729301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:28.730597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:28.812365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:28.827988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:28.835668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 242/483] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:28.860223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:28.871659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:28.906589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:28.962773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c71a3-d74d-4c32-8d4e-e20d2ff64a9f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.027771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.028589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.028871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.029477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.051669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:29.059375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:29.061475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:29.063479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 243/485] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:29.072670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.096072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ed45a-8a85-4c3e-9358-4d2a885d0e07 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.163060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.163861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.164148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.164430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.174978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.191406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:29.199746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:29.200653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:29.201471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:29.206159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161e996-1ce2-417a-b67c-affeb700d9ec None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.207706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 243/486] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:29.213424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.243852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.244989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.245477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.245958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.246946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:29.247460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:29.249040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:29.257664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 244/487] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:29.263217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.316181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.374771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a35d1-8a82-494b-adcf-348503b57913 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.398848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.423988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.425164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.425651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.426645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.438297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeb168-b1b6-4403-9f85-58417bceacac None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.442640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:29.444288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1a97840d-3d38-4523-b372-1798a8f6b5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:29.465475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:29.466333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 245/488] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eec32-2b45-4153-be99-9feb4164a9db None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eec32-2b45-4153-be99-9feb4164a9db None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eec32-2b45-4153-be99-9feb4164a9db None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.471252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 246/489] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:29.471745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b39117-6799-4b65-af8f-00a8e49fdd4e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.471745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b39117-6799-4b65-af8f-00a8e49fdd4e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.471874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b39117-6799-4b65-af8f-00a8e49fdd4e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.473793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 247/490] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:29.475606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b39117-6799-4b65-af8f-00a8e49fdd4e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.480745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.481415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.481701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.481977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.482763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:29.483071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:29.484444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d050e-101f-45cb-ac5b-74bdc4f04b2a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:29.493618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 244/491] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:29.494817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51eead-8ab1-48f7-a62b-a1fd25cd314a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.495107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51eead-8ab1-48f7-a62b-a1fd25cd314a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.495386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51eead-8ab1-48f7-a62b-a1fd25cd314a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.511235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ad51eead-8ab1-48f7-a62b-a1fd25cd314a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:29.512399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad51eead-8ab1-48f7-a62b-a1fd25cd314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:29.577818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 245/492] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:29.579144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.579434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.579712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.598001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b39117-6799-4b65-af8f-00a8e49fdd4e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.600307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:29.602274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:29.630918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.635988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.636925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.637428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.637905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.638868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:29.639395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:29.640975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:29.653625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 248/493] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:29.654659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.680323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 246/494] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:29.681253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.699218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.779712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd03033-42d8-442c-91cb-290a6d1f9d29 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.795296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee48cc1-58bb-41d5-8225-b198831993b8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.823081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.823888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.824170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.824448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.833296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:29.834096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:29.834460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:29.834703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:29.835412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:29.836876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:29.845268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:29.853084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:29.853973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 247/495] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:29.859873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:29.861133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:29.861899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:29.862789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:29.862789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:29.862789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:29.862789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:29.862789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 249/496] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:29.862789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:29.888557 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.950756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:29.967317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d3a55-5023-4784-aec0-f799f60aa46b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:29.975165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca371187-fe85-4042-848b-0ad9b0d64ac6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.004465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.005263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.005549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.005832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.015868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.015868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.015868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.015868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.023665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.024057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:30.025111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:30.031941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:30.033393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 250/497] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:30.039492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:30.047534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:30.054244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 248/498] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:57:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:30.056456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.140600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.144474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6bd5-611d-45bf-b725-79137aae98be None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.159458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797fc07-8e5c-467d-bb38-ae59e10c247d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.177577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.179643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.179643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.179643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.180156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:30.180466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.181816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.190075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 251/499] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:30.190879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.192176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.192831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.193145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.193391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.194114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:30.194569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.195940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.199870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.208732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 249/500] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:30.209707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.290701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f071b1c-5ac1-4cc7-bcd6-4ad7ee95adb3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.305400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e8ac2-5203-42a3-92ff-f0458d2cf00f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.323733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.324392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.324674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.324941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.325696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:30.325999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.327383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb409-ba42-4d4f-b037-df6473dce76d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.336249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 252/501] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:30.337451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11997bd-3288-4b92-9f02-196d40569bc2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.337736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11997bd-3288-4b92-9f02-196d40569bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.338028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11997bd-3288-4b92-9f02-196d40569bc2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.339349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.339605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 253/502] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:30.340317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11997bd-3288-4b92-9f02-196d40569bc2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.342982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.343277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.343627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.344500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:30.344845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.346294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.379599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.384039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 250/503] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:30.384883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.406945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.442851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11997bd-3288-4b92-9f02-196d40569bc2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.476371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.477151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.477431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.477704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.483177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04267-b8d1-48ee-93f7-9ce56022fa59 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.487852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.489269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:30.505935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:30.506963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:30.507862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:30.507862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:30.507862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:30.507862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:30.507862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 254/504] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:30.508283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.520142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.520953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.521223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.521508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.528588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.530031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ff51ed5a-5e77-427a-9512-fc487a22edcf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:30.545248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:30.546136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:30.547057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 251/505] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:30.548208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.548208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.548208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.563536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:30.564712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:30.610144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec7894-668e-4b3c-99ff-87eaa7ef7775 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.618999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.629678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.630601 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 252/506] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:30.631345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.644599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.645389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.645666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.645936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.656337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.658378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:30.674905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:30.675814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:30.676674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:30.676674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:30.676674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:30.676674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:30.676674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 255/507] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:30.677353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.739676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa941d3-693d-42b1-a20b-23d081fbf9ec None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.774149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.774826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.775110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.775388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.776706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba8017-74cc-4821-9bb3-a11508b33604 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.809110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.809691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.809977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.810273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.810990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:30.811293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.812671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.824639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 256/508] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:30.825406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.831797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.842519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.843982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:30.856876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:30.930638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f7e3e-333d-4ff6-8451-c68c4bed4c35 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:30.948153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 253/509] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:30.948981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:30.965191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:30.965858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:30.966137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:30.966444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:30.967281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:30.967590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:30.968982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.004380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:31.005175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.041329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.051335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54602c98-5b67-4214-8290-108234e0e2f1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.085214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.085936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.086526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.086804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.095335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.096780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.098269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.105989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a53fe-a7e9-4d6c-80ab-d92dfc4d245e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:31.115410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:31.116717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:31.117972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:31.117972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:31.117972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:31.117972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:31.117972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 254/511] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:31.117972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.149480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.150142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.150466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.150742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.151462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:31.151769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.153128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.164261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:31.165035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.225047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5086-77a4-41a4-973d-ac4a509f7948 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.259273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.260063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.260347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.260626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.263962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961755-7d17-4792-9699-47b08f47ba2f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.267501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.268952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:31.283414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:31.284327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:57:31.285221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:31.286357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:31.287349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.290124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.296653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.297367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.297644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.298523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.309096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.310563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:31.327938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:31.328843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:31.329735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:31.329735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:31.329735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:31.329735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:31.329735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:31.329995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.332514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.390003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aad4a1-7f75-42bf-82f2-3bdccef0e852 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.423543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.424188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.424469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.424735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.427774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c4af2-c0da-41a1-b5cb-d94a5d105dbb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.461599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.462290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.462577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.462855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.463581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:31.463885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.465243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.477165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 260/515] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:31.477940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.492805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.494464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.496273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.540263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.578683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5be156-346b-43af-bbde-cded02840f1a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.594490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 256/516] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:31.595831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.617279 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.618068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.618387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.618663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.625541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.627045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:31.642601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:31.643457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:31.644342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 261/517] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:31.645209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.694810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b95719-64cc-4f96-9b8c-811384422af7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.696298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.728014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.728674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.728956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.729230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.730060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:31.730393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.731848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.742717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff471-b52f-4f37-8e83-4040c1e077b7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.750116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 257/518] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:31.750975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.765477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.777031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.777686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.777967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.778266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.778987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:31.779293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.780653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.792099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:31.792884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.850797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62078c26-adfa-4108-8f2b-4a054451f622 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.884813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.885477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.885761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.886041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.886776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.888200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.889950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ace24d-969b-4935-bc8d-a28a1266817b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:31.908829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 258/520] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:31 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:31.909568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:31.926133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:31.927237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:31.927648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:31.928092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:31.941243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:31.942791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:31.944349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:31.963298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:31.964240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:31.965117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:31.965117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:31.965117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:31.965117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:31.965117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:31.965748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.005696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.046980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b1f6e-e57f-40d5-8eb4-85f3aefd7299 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.084965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.085644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.085930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.086207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.087105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:32.087415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.088890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.095323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aba08-259e-412c-af3d-447588e9f1e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.109655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 259/522] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:32.111708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.136352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.136774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.137065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.137342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.191093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.211840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.213285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.216982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6580eb-fb25-4310-98d2-581a2709cff0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.247926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.253859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.254705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.254983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.255258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.262121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.263600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:32.278450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:32.279315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:32.280317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 260/523] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:32.280806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.326916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 264/524] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:32.327799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.396855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca045d-3958-4b9c-8965-e85a4db27a3c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.432917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.433921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.434443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.434774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.435554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:32.435907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.437320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.439366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.439690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e422b2-8788-4b2d-b476-d2b4f29e6f24 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.455750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 261/525] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:32.455750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.484676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.485526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.486547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.486840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.489522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.556545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1f7e0-f9d1-4780-a0e6-e5579e860cb0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.558246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.559693 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.593020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.593688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.593971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.594272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.595093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:32.595401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.596818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.615047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 262/526] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:32.620863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.668033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 265/527] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:32.669105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.682899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.706334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.732599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056effa-c6e0-4e40-908b-da849e6d1666 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.770756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.771578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.771828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.772103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.778315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5333d7-be21-4046-b789-d9efd9588d18 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.783632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.785093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:32.802858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:32.803734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:32.804564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:32.804564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:32.804564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:32.804564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:32.804564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 263/528] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:32.804865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.819616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.821078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.821543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.821822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.828530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.830537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:32.844419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:32.845892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 266/529] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:32.847308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:32.910342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874fa743-7998-44a5-899e-950fe6d8437f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.918005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.946158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:32.946388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:32.946949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:32.947238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:32.947524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:32.948483 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=572e1cbd83cb43c396cd474079633af7) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:32.948803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:32.950283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:32.955361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caa9c3-6ada-45b9-86d8-a91f9b7dd220 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:32.956611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 264/530] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/role_assignments?user.id=572e1cbd83cb43c396cd474079633af7&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:32.957317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.005984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.007189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.007593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.007871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.023245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.024723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:33.046912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:33.047883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:33.048738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:33.048738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:33.048738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:33.048738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:33.053160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:33.054132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.113457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b0e92-e8f5-4c4f-8f0b-c71ea012c1ea None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.162614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.163527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.163813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.164095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.164823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:33.165145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.166550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.173636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd09180-4fac-40c8-a1c2-1048b677d159 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.179466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 265/532] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:33.180303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.223514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:33.234429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.234429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.234704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.236024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.238250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:33.238250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.238250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.276657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 268/533] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:33.277553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.301151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:33.320662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5dab1-d4e0-4ad3-8a6b-3f2fbfff0bd5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.367650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.368329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.374246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.374566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.375734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:33.379026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.380430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.394911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:33.395891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.476393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4022-9b82-4f29-98ff-a1a44c9c3b89 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.541163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.541978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.543442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.543740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.558904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.559718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:33.560389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.572310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35b17-f0b3-46f4-8680-1d1e44c8fce4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:33.582902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:33.583769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 269/535] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:33.585669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.620412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.621083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.621371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.621653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.622523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=0713044ffd0247fe8a983d3d1ee15a6b) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:33.622843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.624285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.649006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 267/536] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/role_assignments?user.id=0713044ffd0247fe8a983d3d1ee15a6b&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:33.649006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.755716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:33.884276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68cc0e-72f4-4b76-8265-3031e42d2613 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.893970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21578-8a95-44d5-9391-160a850d3b72 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:33.933247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.934008 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.934194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.934496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:33.935635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:33.936046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:33.937753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:33.958195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 268/537] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:33.959717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:33.977531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:33.986584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:33.987516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:33.987799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:33.988075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.003418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.004898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6a47ef4b-0ec2-496e-bba9-9c195ced530b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:34.034582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:34.035418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 270/538] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01090ce-dc96-402b-9cfc-62b007d163ce None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.036365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01090ce-dc96-402b-9cfc-62b007d163ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.036921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01090ce-dc96-402b-9cfc-62b007d163ce None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.039948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 271/539] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:34.040758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01090ce-dc96-402b-9cfc-62b007d163ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.087859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267e28f-62c3-44ef-98fe-a9093055e744 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.125492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.126737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.127021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.127299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.128225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=4ec4a5d37c914c5e8296aa9e14c9c3f8) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:34.128542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.130101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c17d-db8c-4f18-98d3-1b94b307a0ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:34.136552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:33 2022] GET /identity/v3/role_assignments?user.id=4ec4a5d37c914c5e8296aa9e14c9c3f8&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:34.138043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.138509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.138798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.171129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:34.174986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:34.218081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01090ce-dc96-402b-9cfc-62b007d163ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.284672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 270/541] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:34.284974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:34.304866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.305612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.305898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.306174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.307064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:34.307376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.308994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:34.327914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 272/542] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:34.331458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.334127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.344697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:34.454370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb10195-4bd4-4dfc-ae2a-f3d2de265b7a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.492778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343d804-732a-4ba5-88e2-470e30a4fd2b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.512267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.512928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.513213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.513488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.514359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=78768c5fb13646dcad006e323df270a2) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:34.514674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.516360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:34.529931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 273/543] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/role_assignments?user.id=78768c5fb13646dcad006e323df270a2&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:34.545434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.546193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.546521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.546804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.557984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:34.566649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:34.567592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:34.568389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 271/544] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:34.574027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.667664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:34.733779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8f2f-a6e5-421d-86fc-c0f23e23daf2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.773429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.774157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.774476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.774753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.775523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:34.775831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.777217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:34.786819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 274/545] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:34.791981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.878600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:34.915419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb328f9-bc85-428d-9661-e70f803f6671 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.953796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.955141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.955431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.955728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.972286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.973760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c62b9015-2061-4c68-b91b-fcc075874ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:35.003747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:35.004645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:35.005480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:35.005480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:35.005480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:35.005480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:35.006431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 272/546] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:35.013360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:35.197121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8dbdd-7e45-4a9b-90d4-92c5a2e267c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.216977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:35.244719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.245452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.245748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.246032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.246790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:35.247102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:35.248460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424eb0-d083-44c5-8849-3368aeb6e832 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:35.259134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cc05-f804-40d4-bc45-0c32eb421909 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.259705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cc05-f804-40d4-bc45-0c32eb421909 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.260202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4cc05-f804-40d4-bc45-0c32eb421909 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.261660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 275/547] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:35.261924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 273/548] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:35.266689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4cc05-f804-40d4-bc45-0c32eb421909 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:35.267177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.267505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.267745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.285901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:35.287122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:35.359400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 276/549] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:35.385632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:35.495948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb0116-227c-4dc1-92ba-37117ae2ec1e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.498510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:35.533812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.534786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.535071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.535348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.546961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:35.555882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:35.557237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:35.558212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 277/550] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:35.564083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:35.582944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4cc05-f804-40d4-bc45-0c32eb421909 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.633260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:35.673477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066ed8-ff95-4c1e-9716-21e9f570bd57 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.674928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.675754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.676039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.676318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.691567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:35.693101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:35.718827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:35.721321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:35.723588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 274/551] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:35.730265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:35.734355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.735761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.736293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.736728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.737682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:35.738445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:35.740590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:35.759287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 278/552] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:35.766852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:35.816590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:35.922798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bedac-7ddb-42e9-acc1-cecdb7a18da3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.953619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2991c3-6896-4ca4-8e24-2e7f2e0c0ac0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.971919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.973149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.973572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.974016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.975024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:35.975472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:35.977042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:35.998268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.999134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.999419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.999699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.023010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 275/553] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 08:57:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:36.024008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.025540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.029826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:36.078469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:36.080116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:36.080988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:36.080988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:36.080988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:36.080988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:36.081214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.081804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 279/554] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:36.087047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.165177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139af240-1095-48a1-bc42-2e582972c4c5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.188599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.214364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58146-f936-4eb2-876d-49b933927f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.215440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58146-f936-4eb2-876d-49b933927f1f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.215737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58146-f936-4eb2-876d-49b933927f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.216152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58146-f936-4eb2-876d-49b933927f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.218134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af46e5-21ba-4b4a-9a41-c65346148156 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.256783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.257543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.257917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.258292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.259088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:36.259469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.260891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56646c65-069f-4b8f-a9a4-01d015c2fbd9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.282636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 280/555] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:36.283926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43a810-e486-49a6-b189-bb76c29aa69e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.284196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43a810-e486-49a6-b189-bb76c29aa69e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.284472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43a810-e486-49a6-b189-bb76c29aa69e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.285772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 281/556] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:36.286495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43a810-e486-49a6-b189-bb76c29aa69e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.302264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd58146-f936-4eb2-876d-49b933927f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.303865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd58146-f936-4eb2-876d-49b933927f1f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.346051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.399523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43a810-e486-49a6-b189-bb76c29aa69e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.415433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 276/557] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:36.416750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.417038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.417318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.435343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:36.436542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:36.440592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.441393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.441678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.441959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.445501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.451042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.452660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:36.469311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:36.472516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 282/558] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:36.474838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.524347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 277/559] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:36.525271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.598393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.599401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbced1-c44e-4364-aa1a-6b07d74e4e1c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.637269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dd888-5670-444c-bec8-eafdf6ff8256 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.638837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.639633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.639911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.640181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.651159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.652872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:36.671361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:36.672338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:36.673759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:36.673759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:36.673759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:36.673759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:36.673979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.674248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.674810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.675652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:36.676090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.676467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 283/560] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:36.677363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b8b3a-377c-4faf-a8b8-25ec477ae92e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.677539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.697973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 278/561] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:36.699789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7fd14-cd7f-4fa5-9a26-74171e0178ee None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.700082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7fd14-cd7f-4fa5-9a26-74171e0178ee None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.700355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7fd14-cd7f-4fa5-9a26-74171e0178ee None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.701724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 279/562] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:36.707463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7fd14-cd7f-4fa5-9a26-74171e0178ee None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.739320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.792228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e98c-db1c-4952-86bb-759f7b4cf05e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.806847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7fd14-cd7f-4fa5-9a26-74171e0178ee None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.828024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.828879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.829703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.829978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.835960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.840398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:36.845987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.846686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.846973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.847252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:36.848064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:36.848977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:36.849841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:36.850993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:36.850993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:36.851118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 284/563] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:36.851118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.854815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad7e7f-0815-451e-a9dd-21928831b9e7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:36.867472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 280/564] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:36.872167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.872466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.872747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:36.889968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:36.891205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:36.955824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24f0c2-2c58-4d47-9da4-57bbfa24ba33 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:36.959811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 281/565] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:36.963253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:36.967822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:36.995962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:36.996665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:36.996949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:36.997223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.008344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.009789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:37.027547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:37.028855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:37.029728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:37.029728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:37.029728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:37.029728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:37.033814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 285/566] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:37.034528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.068436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a1119-ed8a-4e73-92b8-de61fd59826e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.084311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.103329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.103932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.104214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.104486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.105243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:37.105580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.106990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.115401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 282/567] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:37.116421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.146921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2fb39-c55e-4a31-ba4b-2e6822e2e14f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.179731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.180517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.180795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.181066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.187507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.189482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6ec47299-2f2f-4568-b653-f3d9494e050e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:37.203292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:37.204339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:37.205269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 286/568] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:37.205764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab335e-f464-4cdd-8dc1-efce1bc19189 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.212213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab335e-f464-4cdd-8dc1-efce1bc19189 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.212213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab335e-f464-4cdd-8dc1-efce1bc19189 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.212213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 287/569] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:37.212213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab335e-f464-4cdd-8dc1-efce1bc19189 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.223016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f323-f4de-4e9e-9350-5022c53ad76d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.233134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.257667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.258493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.258777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.259058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.269799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:37.277512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:37.278479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:37.279344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 283/570] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:37.280058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.315233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab335e-f464-4cdd-8dc1-efce1bc19189 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.318594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.349028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.349688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.349972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.350272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.350994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:37.351300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.352653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.363723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 288/571] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:37.364448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.380587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8c0a6-8045-4b96-8e0f-c52f84be7066 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.414538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.415321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.415601 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.415875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.426050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.427509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.443389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cd432c32-e55f-4f07-b3f7-bea4f7449a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:37.444285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:37.445430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:37.446611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:37.446611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:37.446611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:37.446611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:37.446611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 284/572] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:37.446968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.447141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.447457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.463768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:37.464928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:37.468097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639be54-d2fa-475c-bc61-1be088bfaba4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.501845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.502533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.502821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.503104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.503895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:37.504211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.505617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.517934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 289/573] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:37.518605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.531358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 285/574] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:37.532794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.553914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.618096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb201072-85eb-45a1-8a72-2008445ca1f4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.631347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20845ea-64de-402b-a48f-21008eb5c389 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.651247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311720-da62-4471-8870-43396e7e165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.651904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311720-da62-4471-8870-43396e7e165a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.652184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311720-da62-4471-8870-43396e7e165a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.652458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a311720-da62-4471-8870-43396e7e165a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.653194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311720-da62-4471-8870-43396e7e165a None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:37.653505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311720-da62-4471-8870-43396e7e165a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.654885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a311720-da62-4471-8870-43396e7e165a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.663074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 290/575] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:37.664007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311720-da62-4471-8870-43396e7e165a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.665314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.666096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.666402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.666672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.666770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.673907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.675382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:37.689716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:37.690777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 286/576] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:37.691677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.770389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a311720-da62-4471-8870-43396e7e165a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.772241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.790717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc042477-93de-42b1-b93d-650b3e8ef411 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.803519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.804175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.804459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.804734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.805454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:37.805759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.807139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.819086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 291/577] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:37.819869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.828323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.829543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.829833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.830111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.830980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=aef646744cb34d9eb6068cb54a31315e) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:37.831297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.832713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.838063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 287/578] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/role_assignments?user.id=aef646744cb34d9eb6068cb54a31315e&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:37.838861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.892570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:37.938264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fcd8-cdd6-443f-9011-e7620cb60383 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.955169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8321938-b211-4682-b788-55421ab20bcf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.977232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.978034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.978343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.978626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.991535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:37.993519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.994387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.994678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.994957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:37.999230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:38.000147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:38.001579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 292/579] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:38.002313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.007331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.008844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.011523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:38.029473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:38.030350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:38.035103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:38.035103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:38.035103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:38.035103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:38.035103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 288/580] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:38.035103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.119241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc213-c6b9-420d-a272-7d80e1710e8f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.142524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a22c-eedb-44a6-9530-e03d99123a52 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.143080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.156139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.156806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.157147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.157437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.158772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:38.159365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.160500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.177408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 293/581] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:38.177408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.185075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.185957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.186337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.186619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.194435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.195867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:38.210385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:38.211320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 289/582] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:38.212289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.274777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.300301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fe3c0-399a-46cf-8664-75487ebe6884 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.323039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89249632-573f-4beb-a61d-cbbc71a30b65 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.339633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.340315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.340602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.341072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.341636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:38.341948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.343346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.355808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 294/583] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:38.355808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.362410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.363078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.363364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.363644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.364373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:38.364688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.366360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.379699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 290/584] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:38.384768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.404012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.462149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274a67a-cb3a-4103-bd46-ff44e9b44953 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.485080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be569b84-6893-4450-b4dd-3683e3f2b374 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.497367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.498473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.498762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.499158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/572e1cbd83cb43c396cd474079633af7/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.502146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.518049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=572e1cbd83cb43c396cd474079633af7, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.519571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.519914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.520589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.520873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.521151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.521998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:38.522349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.523750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.542271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 295/585] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:38 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/572e1cbd83cb43c396cd474079633af7/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:38.542271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.555571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 291/586] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:38.556544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.654906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.666556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57c4da-4683-4b53-adde-cd2a4333f270 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.685236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c42a7-ffbd-445c-bbd2-e00017166b9a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.726066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.726907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.727190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.727471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.736059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.736865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.737148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.737423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.741535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.743054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.746262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.747792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:38.762964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:38.763894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:38.764818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:38.764818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:38.764818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:38.764818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:38.764818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 296/587] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:38.765538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:38.767292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:38.768193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:57:38.769151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:38.771474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 292/588] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:38.774180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.811531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.886211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30984d0-8258-4c44-8d7e-336d0dea5f60 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.894428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cc044-c8e4-467b-ae05-b2f102bbe31c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:38.922143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.923726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.924155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.924600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.925479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:38.925928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.927479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.933508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:38.934350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:38.934636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:38.934913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:38.946747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 293/589] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:38.948102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:38.948396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:38.949921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:38.957496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:38.971425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:38.972626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:38.973725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:38.973725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:38.973725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:38.973725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:38.973725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 297/590] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:38.973725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.069633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.076904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef6b01-13a7-4ba7-9970-9bd185e23718 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.085473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e109-e767-48a1-8385-13522d455a58 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.112455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.113359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.113818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.114284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.115354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:39.115822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.117663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.123167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.123964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.124249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.124527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.132834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.134678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.138506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 294/591] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:39.139687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:39.150426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:39.151391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:57:39.152362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:39.156456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:39.157411 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.220074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.246198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761aa39-6499-40b7-a76b-8ee9e1bccbb4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.267627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca56d27-013b-4c0d-93a5-a3ee8f3a9043 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.281656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.283109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.283619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.284097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.285015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:39.285521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.287125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.304522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:39.304522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.308110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.309525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.309525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.309525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.320651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.321407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.323155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:39.343751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:39.345240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:39.346135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:39.346135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:39.346135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:39.346135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:39.346135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 299/594] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:39.346135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.418190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276fe3-085f-4fb2-a5a9-9fc4bfec821d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.453646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.454907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.455201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.455482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.456327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:39.456640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.457234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6400b-9808-44fa-9ab6-51a86c0f5c70 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.458062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.468788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.480974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 296/595] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:39.480974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.503729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.504934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.505243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.505527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.514357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.516785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:39.534164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:39.535133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:39.536034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:39.536466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 300/596] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:39.536987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.566006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.599293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f442-4f8d-46f9-86fc-224e8a997793 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.633805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.634465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.634754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.635036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.635766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:39.636078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.637456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.654135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 297/597] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:39.655019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.659447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05644838-ae79-4acd-b4dd-5d2eb2fbfe0e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.698982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.700249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.700775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.701655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.715095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.717007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:39.737773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:39.738780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:39.739873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:39.739873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:39.739873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:39.739873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:39.747014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 301/598] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:39.748292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.762402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509e12b-2a27-42e8-9b7e-b3dcca647b1f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.777312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.792060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.798674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.799420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.799658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.799898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.800695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:39.801006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.802488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.815230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 298/599] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:39.816064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.869394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86174bb-64cc-4808-aac9-302082a975a3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.909704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.910690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.911078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.911451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.917801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1415c-eac4-495b-aae5-bf593455f6ff None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:39.918753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.920287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:39.935002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:39.936046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:39.937126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:39.940788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 302/600] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:39.941494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:39.957098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:39.957759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.958045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.958357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.959085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:39.959394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:39.960757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a87d8-117f-4fee-a9a5-e8d7aa1f3d15 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:39.976540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 299/601] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:39.976540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b8f0-8cb1-46dc-a6e3-2a476428497b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:39.976540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b8f0-8cb1-46dc-a6e3-2a476428497b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:39.976540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1b8f0-8cb1-46dc-a6e3-2a476428497b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:39.976540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 300/602] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:39.976540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1b8f0-8cb1-46dc-a6e3-2a476428497b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.036670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.045349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.066503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa782a48-0b37-4e20-93cb-b9d32bb975b6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.093888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1b8f0-8cb1-46dc-a6e3-2a476428497b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.101719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.102921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.103387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.103808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/0713044ffd0247fe8a983d3d1ee15a6b/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.119949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=0713044ffd0247fe8a983d3d1ee15a6b, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.121702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.130889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.131551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.131934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.132244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.133106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:40.133432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.134898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee7a8-ade3-4afe-b64c-799d8c9777da None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.137472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 303/603] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:39 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/0713044ffd0247fe8a983d3d1ee15a6b/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:40.138427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.153401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 301/604] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:40.155244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.155761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.156286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.180675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:40.182889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:40.269917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfe94b-3fe6-499a-9fb3-71c99b0fe1ad None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.272076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 302/605] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:40.273598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.306946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.315701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.316627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.316936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.317462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.326369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.327735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.327956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:40.343460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:40.345174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:40.346320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:40.350265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 304/606] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:40.350265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.403269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b6e7a-515a-491b-aa1f-9cd5b8b19bc2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.440322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.441460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.441828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.442150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/4ec4a5d37c914c5e8296aa9e14c9c3f8/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.460595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=4ec4a5d37c914c5e8296aa9e14c9c3f8, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.462719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.480028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 303/607] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:40 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/4ec4a5d37c914c5e8296aa9e14c9c3f8/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:40.480451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900136ce-8c8e-46fd-99ce-1d2adce1cd31 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.481443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.521509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.522568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.523716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.523716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.535467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:40.543563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:40.544793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:40.545855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:40.552309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 305/608] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:40.555080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.621502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.645317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaf341-6971-4761-bc3b-7f9c317e414c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.662591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.715988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.716666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.716952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.717230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.718036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:40.718388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.720369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dc3b9-5512-421d-a620-b3384c3ac5f7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.736032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 304/609] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:40.737665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd094f-5c2a-4357-bc6d-4a434902e850 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.738188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd094f-5c2a-4357-bc6d-4a434902e850 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.738752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd094f-5c2a-4357-bc6d-4a434902e850 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.740197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 305/610] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:40.742605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd094f-5c2a-4357-bc6d-4a434902e850 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.746020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7454a-143a-4385-b55f-955f5a23fa7d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.789407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.790084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.790395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.790673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.791435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:40.792119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.793801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c709-1f1c-4e38-aca1-6e11f6deb3c8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.810306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 306/611] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:40.811929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.812598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.814132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.837059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:40.838990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:40.863763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd094f-5c2a-4357-bc6d-4a434902e850 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:40.900853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:40.901848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.902268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.902644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/78768c5fb13646dcad006e323df270a2/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.919379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=78768c5fb13646dcad006e323df270a2, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:40.920998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:40.932337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:40.935620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 307/612] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:40.936979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.938257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 306/613] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:40 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/78768c5fb13646dcad006e323df270a2/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:40.984163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:40.999312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:41.069157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e5a4c-78e3-4f96-b035-e80bb8fe0ec3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.109746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.111029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.111528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.112010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.124049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.125914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.141852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d1b38-26cd-414b-be1a-0587b74f73db None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:41.145926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:41.147139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:41.148058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:41.148058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:41.148058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:41.148058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:41.150364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 308/614] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:41.157973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.206126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.207168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.207456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.207738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.230926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:41.240293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:41.241494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:41.242740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:41.245345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 307/615] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:41.253284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.282957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:41.289184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79ddc-9f0a-4192-8106-4c32ec9caac4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.321849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:41.326711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.327400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.327685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.327959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.328710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:41.329714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.331632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.346919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 309/616] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:41.352517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.385952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3b7cc-2401-4d18-821b-d0e57e017f49 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.460752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.461349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.461637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.461919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.462747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:41.463060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.464458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.484415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 308/617] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:41.487782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.551192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6a71-d677-4c6f-b087-80f02cd6d3f0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.595463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.596286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.596577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.596860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.607428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.608896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:41.632916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:41.633884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:41.634852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:41.639485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 310/618] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:41.649153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.663708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7e4f4-98b6-4f77-b17a-f481f646f3cc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.676658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:41.704257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:41.729454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.730185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.730496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.730776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.755261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.756945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:41.794446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:41.795380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:41.796427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:41.796427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:41.796427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:41.796427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:41.798380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 309/619] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:41.807999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601def-9286-4127-abb5-a332650bbb8c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.808813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.880584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.881280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.881572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.881852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.890697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:41.891023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.893068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.928860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 311/620] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:41.935706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.955198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18d84c-6626-4d17-afba-285d5ab4446b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.992619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.993209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.993496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.993777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.994647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:41.994960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.996331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.009875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 310/621] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:42.019684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.086287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.110672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.157296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54279-45f4-4f28-9c9f-867eef7af797 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.182848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba93e57-87d0-4221-bb9c-c49914a57f70 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.219962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.220761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.221047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.221323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.228754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:42.230358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.235830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.236863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.237358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.237824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:42.245403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:42.246340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:42.247753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 311/622] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:42.253003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.265003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:42.268741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:42.299972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:42.301038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:42.301922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:42.301922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:42.301922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:42.301922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:42.306645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 312/623] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:42.311069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.447415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeabc49-bb0a-46aa-9f0d-5495ee7c0298 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.450743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.465215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87c8b-07ff-40ed-abda-5f00cbe8f559 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.477149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.492705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.493763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.494278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.494754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.496334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:42.497079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:42.499357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efea4e-e15d-4758-bf19-a469e48fc246 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.510322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.511000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.511285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.511569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.512414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:42.512724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:42.514139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d6b40-bef6-4bc1-8cf3-13f9a9298802 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.517045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 313/624] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:42.519425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f95d-3a9a-4cca-96d0-cb1e0988ecc6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.519939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f95d-3a9a-4cca-96d0-cb1e0988ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.520417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334f95d-3a9a-4cca-96d0-cb1e0988ecc6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.522422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 314/625] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:42.526868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334f95d-3a9a-4cca-96d0-cb1e0988ecc6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.542339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 312/626] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:42.543940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.544428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.544911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.566855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:42.568358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:42.645602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334f95d-3a9a-4cca-96d0-cb1e0988ecc6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.654240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 313/627] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:42.654240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.704691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.705747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.706267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.706720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.713842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:42.715529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:42.730606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:42.731513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:42.732539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:42.735803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 315/628] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:42.736972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.737100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.758566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503e2c-8cd5-4554-aa5d-9753ec06d685 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.786663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.796878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b355ca-47fe-4499-83e3-f433511fd5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.798550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b355ca-47fe-4499-83e3-f433511fd5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.798999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b355ca-47fe-4499-83e3-f433511fd5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.799422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b355ca-47fe-4499-83e3-f433511fd5a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.842376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49eb04-a84f-4932-a79e-7e3e547b0d3a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:42.873661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b355ca-47fe-4499-83e3-f433511fd5a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:42.875417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b355ca-47fe-4499-83e3-f433511fd5a9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:42.878781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:42.879698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.880077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.880450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.891117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:42.898966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:42.900102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:42.901155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:42.902529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 316/629] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:42.903166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:42.969290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:42.995953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 314/630] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:42.995953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18115233-fad7-42c5-8cfb-8c82cfca44f6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:42.995953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18115233-fad7-42c5-8cfb-8c82cfca44f6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:42.995953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18115233-fad7-42c5-8cfb-8c82cfca44f6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:42.995953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 315/631] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:42.995953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18115233-fad7-42c5-8cfb-8c82cfca44f6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.011657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5aba3-fc20-44e9-a769-35731599cbac None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.020898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.052968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.053635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.053929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.054192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.055090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:43.055317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.056732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.074250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 317/632] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:43.074250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.115694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18115233-fad7-42c5-8cfb-8c82cfca44f6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.151481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.152139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.152420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.152692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.153441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:43.153739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.155143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94e2f1-884b-48cc-a861-24b6c19d84f6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.163076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 316/633] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:43.164337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.164626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.164953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.181605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:43.182814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:43.189373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acee72-972a-4de6-91b3-60895c8b723e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.221389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.230571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.231364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.231648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.231923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.242906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.244333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.260817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 317/634] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:43.261800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:43.262152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:43.263041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:43.263948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:43.263948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:43.263948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:43.263948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:43.268276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 318/635] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:43.269116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.289148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.372621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b63e8-b8d3-4ba4-8d15-dedfed90668c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.375515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004f904-18a7-4987-8956-d4184828f91b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.409517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.410538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.410825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.411101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/aef646744cb34d9eb6068cb54a31315e/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.412483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.413424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.413846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.414299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.425417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.426283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=aef646744cb34d9eb6068cb54a31315e, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.426912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.427711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.440359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 318/636] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:43 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/aef646744cb34d9eb6068cb54a31315e/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:57:43.441139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:43.445363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:43.446512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:43.447551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:43.447551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:43.447551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:43.447551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:43.451396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 319/637] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:43.452403 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.474923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.540778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.567115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2a787-b99b-4bf4-9e63-44844f903824 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.576622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c807b8e-a5eb-4f02-807d-f7c52607bb53 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.606465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.607139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.607421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.607702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.608458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:43.608765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.611153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528653eb-ca48-4c2d-98ad-289fd4c80ade None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.616731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.617522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.618175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.618175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.623056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 319/638] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:43.624223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa99a-bde2-4575-9df4-a2c88daecf0e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.624513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa99a-bde2-4575-9df4-a2c88daecf0e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.624795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fa99a-bde2-4575-9df4-a2c88daecf0e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.626178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 320/639] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:43.628319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa99a-bde2-4575-9df4-a2c88daecf0e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.631477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:43.639195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:43.640311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:43.641249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 320/640] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:43.641945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.724051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.744447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fa99a-bde2-4575-9df4-a2c88daecf0e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.749489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6bba5-d184-47a9-ad20-3ef137870a73 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.777551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.780588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.781629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.782521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.782861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.783590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:43.783894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.784883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.785267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a917d47-6c86-477c-b181-19a51115d06f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.785685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.785968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.786267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.793636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.795038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.797803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 321/641] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:43.803379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.803669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.803962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:43.810488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:43.811612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 321/642] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:43.812534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.828142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:43.830133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:43.901691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:43.902551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.940236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688eed4-1e9c-44ec-8b26-79e1567a8932 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:43.977827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:43.978523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:43.978805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:43.979077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:43.979818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:43.980116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:43.981460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:43.990398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 322/644] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:43.990726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:43.999817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.031230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751931ce-5a39-4444-a6de-5f4b9747cff3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.052771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.066932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.067720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.068007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.068282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.076082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.077500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:44.092777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:44.093776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 323/645] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:44.095471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.116742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf454-3489-4cc7-a92f-ce1cb0b838de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.157905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.158616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.158902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.159172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.159995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:44.160315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.161730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.174966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 323/646] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:44.175783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.207612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011d545-9627-4b87-bbd0-989595993fb0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.244042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.245160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.245448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.245775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.247664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.259218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:44.267982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:44.268917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:44.269753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 324/647] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:44.270511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.284736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3d13c-3e35-4f79-b191-e17ccc12b833 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.300802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.322739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.323463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.323748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.324020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.334527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.335959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:44.353611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:44.354744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:44.355688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:44.355688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:44.355688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:44.355688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:44.355688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 324/648] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:44.355688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.383954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f89b3-478a-49d3-8b3a-7e27800c39cd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.422027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.423310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.423596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.423884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.424723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:44.425035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.426466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.448305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 325/649] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:44.448305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.464616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1638a-a582-48fb-8d58-92830c8c1655 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.501897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.506295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.507110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.507378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.507659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.508505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=572e1cbd83cb43c396cd474079633af7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:44.508817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.510247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.526270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 325/650] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/role_assignments?user.id=572e1cbd83cb43c396cd474079633af7&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:44.526270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.557168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.572111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22d3d-e9e2-49d5-b2ba-7d898bbb618f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.612902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.614021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.614641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.615036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.616179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:44.616601 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.618261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.628057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 326/651] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:44.633720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.667157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82812e-d452-4894-b92b-b6070cdec303 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.710624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.711771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.711771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.711964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.712959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:44.712959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.714173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.727649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 326/652] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:44.728382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:44.765299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372d73-c40d-4abf-8f01-329152ef9456 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.784040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.807287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.807598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.807986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.808384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.835458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.851000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3b5ec-d45a-4499-94df-fd55a7a441b0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:44.893083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:44.893806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:44.894093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:44.894308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.894415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:44.895900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.906395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:44.908409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:44.928576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:44.929503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:44.930433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:44.930433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:44.930433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:44.930433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:44.930433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 327/653] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:44.931209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.029258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 327/654] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:45.030272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.048615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.052977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27c5f6-f0df-4519-983c-2a0c6d1baf8e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.095485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.096312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.096591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.096908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.105900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.107495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.110800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:45.125188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:45.126854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:57:45.127822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:45.131582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 328/655] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:45.132454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.157698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d38ebc-5221-45f1-89ce-c8d452671621 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.201966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.203067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.203538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.204579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.205486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:45.205980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.207552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.219831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 328/656] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:45.220969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.253424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b37ed8-7258-45a5-8861-fe4cb8afd48a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.293745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.294567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.294849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.295122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.307577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.310249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.312211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:45.334566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:45.335491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:45.336367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:45.336367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:45.336367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:45.336367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:45.338595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 329/657] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:45.339723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.340149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c036e-262f-41fa-87cf-399007b4e683 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.385970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.386687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.386967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.387241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.388520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:45.388840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.390813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.399195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.416914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 329/658] 10.222.0.16 () {56 vars in 1139 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:45.417755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.454134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f951f-f67f-4628-8791-8c25fdf1f6ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.490781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.492185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.492695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.493194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.503056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.504956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:45.524335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:45.525305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:57:45.526262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:45.528606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 330/659] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:45.529633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.551175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b89785-b9d1-479f-93e8-ed520ecd7eea None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.584152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.590194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.590885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.591207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.591444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.592166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:45.592472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.593851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.606020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 330/660] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:45.606667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.639340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26abf25-2ff2-47f6-8982-b183c6b3fd3c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.653505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.678098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.678712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.678998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.679266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.714298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83cf9-9805-4dce-a6aa-a58b53fc3307 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.745505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.747035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.749907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.751155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.751439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.751712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.752545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:45.752853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.754280 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605a19e-faf9-43f8-8eae-f7b4c6d6eff2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.777216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 331/661] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:45.777216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee58a-bf1c-441b-80b6-3f26d3da8b4c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.777216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee58a-bf1c-441b-80b6-3f26d3da8b4c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.777216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee58a-bf1c-441b-80b6-3f26d3da8b4c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.777216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 332/662] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:45.777216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee58a-bf1c-441b-80b6-3f26d3da8b4c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.835073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.870865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 331/663] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:45.870865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:45.887884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.889285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee58a-bf1c-441b-80b6-3f26d3da8b4c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:45.926163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:45.926980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.927269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.927612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.934197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:45.935604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-74298591-eedd-4290-99a1-6965b74aed09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:45.949080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:45.950141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:45.951191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 333/664] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:45.951794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:45.952080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:45.952357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:45.970344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:45.971505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:45.982906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c675a6d-0562-4794-b23e-7a2dc88c1fc8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.023627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.024278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.024560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.024834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.041779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 334/665] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:46.042919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.096703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.104408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.106070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.120886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.158416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfc185-beba-4d5c-a7a9-56e5f138c327 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.198148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.199035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.199421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.199798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.212415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 332/666] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:46.213248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.218496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.219999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:46.238170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:46.239108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:46.240002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:46.240002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:46.240002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:46.240002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:46.240002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 335/667] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:46.241175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.323305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f5c21-9e2a-497d-9e38-66c2a8c6b8d6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.337669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.340200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.350982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944062b6-8665-4af5-a3af-7ab1801c6d7e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.360753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.361465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.361747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.362026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.362841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:46.363154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.364570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.381763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 333/668] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:46.382642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.388038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.388835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.389115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.389386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.399898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:46.407634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:46.408581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:46.409422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 336/669] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:46.410131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.488351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955734b7-9740-45ab-9925-f3365357acf3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.523750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.523983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152d14-a898-4500-8866-1ef52d8ff8fe None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.524977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.525439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.525886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.537291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.538830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:46.555696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:46.556787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:46.557715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:46.557715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:46.557715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:46.557715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:46.557715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 334/670] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:46.557715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.565233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.565902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.566183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.566486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.567212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:46.567517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.569301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.587915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 337/671] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:46.587915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.590070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.601465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.675951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544a715-5f3e-40a0-9eb4-fd989cc16826 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.696581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb540d-4cbb-4f1e-9a49-6ec2bee945cd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.721684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.722369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.722653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.722933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.723762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=0713044ffd0247fe8a983d3d1ee15a6b) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:46.724078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.725482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.739645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 335/672] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/role_assignments?user.id=0713044ffd0247fe8a983d3d1ee15a6b&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:46.739863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.739988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.740084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.740084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.740084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.740084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:46.740084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.740084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.750327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 338/673] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:46.750327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.834320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.844356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:46.859945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ae4c2-79a0-42d9-8b7a-06e703a2730a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.860534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09649164-6bec-4f01-b90d-68e3d3977fbd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:46.898911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.899594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.899870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.900171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.900985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:46.901287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.901398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:46.902087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.902420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.902666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44005a5-4804-4686-b7aa-b544730198ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.902773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.910608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:46.912046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:46.915385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 336/674] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:46.916700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94440a-bcbd-44ab-b06d-69d51181f987 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:46.916990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94440a-bcbd-44ab-b06d-69d51181f987 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:46.917265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94440a-bcbd-44ab-b06d-69d51181f987 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:46.923396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 337/675] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:46.923396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94440a-bcbd-44ab-b06d-69d51181f987 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:46.934577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:46.935728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 339/676] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:46.936890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.035491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94440a-bcbd-44ab-b06d-69d51181f987 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.056516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c6b62-9eb0-4c3a-983e-a15695583f26 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.072999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.073791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.074071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.074605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.085647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.087269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.095926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.096891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.097987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.098303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.098575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.100680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-261c8788-18e4-4b54-8181-63efca59b471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:47.105936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:47.107006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:47.107930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:47.107930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:47.107930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:47.107930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:47.108186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.108186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.115516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 338/677] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:47.117106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.117393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.117665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:47.124067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:47.124936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:47.126825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 340/678] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:47.127336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.139085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:47.140289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:47.205230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 339/679] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:47.206064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.248552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a83c4-fc01-4d29-9952-155a6058ff7c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.285076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.286346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.286677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.286964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.287769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:47.288084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.289533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.302296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 341/680] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:47.303097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.323608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b4d09-c5bb-43a6-8248-cd3b45c608d0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.354789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.360070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.361961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.362930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.363397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.363681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.364469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:47.364790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.366438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.384201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 340/681] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:47.384201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.408797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e061a-55f0-4b6e-84a7-58164db2c1b2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.444376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.445040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.445326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.445604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.446435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:47.446754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.448408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.460644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 342/682] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:47.461471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.494891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730c24-914e-438c-90e4-2ad1a452b128 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.529870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.530698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.530987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.531266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.541953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:47.549539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:47.550622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:47.551488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 341/683] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:47.552263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.567373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc2a35-4661-4982-a7aa-b43843f23ffd None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.583680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.606710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.608575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.609233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.609522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.609834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.611124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=4ec4a5d37c914c5e8296aa9e14c9c3f8) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:47.611443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.613038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.619979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 343/684] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/role_assignments?user.id=4ec4a5d37c914c5e8296aa9e14c9c3f8&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:47.631343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.663662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339f30f-3ac3-4c89-a050-fe3b8091f31f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.703217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.704068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.704414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.705165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.713516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.715040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:47.730244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:47.731497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:47.732718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:47.736890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 342/685] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:47.738169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.776159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786fbf0-0243-4c3e-b109-d126a3f82598 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.824547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.825798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.826186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.826642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.827919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=78768c5fb13646dcad006e323df270a2) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:47.828308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.830765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.837264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 344/686] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/role_assignments?user.id=78768c5fb13646dcad006e323df270a2&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:47.837956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.852138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4bc57-d14a-4df6-a6ce-f3a98952ed8a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:47.865085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.892941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:47.896115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:47.896856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:47.897965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:47.898299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:47.899684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:47.900015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:47.902337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:47.914602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 343/687] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:47.920933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:47.977224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6daf1-78b6-478d-b630-82b1e9344265 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.023204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.023896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.024181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.024459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.025315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:48.025627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.029534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.047976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 345/688] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:48.053118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.066063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131e3ac-296d-4354-b854-605eb2d3d223 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.120945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.122180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.122499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.123048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.146537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.149261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:48.172073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:48.173039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:48.173930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:48.173930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:48.173930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:48.173930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:48.173930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 344/689] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:48.179184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.192692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:48.195686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3949fd5-c1c6-429d-9113-6a2639fdb4ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.218546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:48.236925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.237593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.237885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.238168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.324295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.325669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.326933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e57e3a-50ca-4cbc-863d-9c294fd62a47 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.371849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.372965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.373455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.373924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.374888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:48.375948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.377523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.390514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 345/690] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:48.396890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.507209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:48.514392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 346/691] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:48.518116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.526576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:48.534978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd548-6054-4154-91a7-210d23404651 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.599605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.600474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.600761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.601037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.614386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.617071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:48.642188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:48.643193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:48.644215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:48.646936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 346/692] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:48.652643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.675282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d673d-ce17-48c1-aefd-dc787a7a692f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.710949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.711742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.712020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.712290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.732241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.733843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:48.766907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:48.767863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:48.768756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:48.768756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:48.768756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:48.768756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:48.768756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 347/693] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:48.775762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.826371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140dd6-174a-4ad5-8ccb-e6159c337f38 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.863661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.864338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.864669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.864952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.865794 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:48.866552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.868361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:48.888435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 347/694] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:48.893725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:48.898523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:48.904702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:48.957221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e508f5-9ed4-4db0-9a6d-8239ccd40d00 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:48.994572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:48.995234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:48.995515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:48.995787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:48.996510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:48.996815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:48.998167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.010481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 348/695] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:49.020631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.077231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da516e-74cc-487a-af3d-f1ddbe54ffe1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.116965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa3e2c-caca-4b92-95fd-09e959f04666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.117739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa3e2c-caca-4b92-95fd-09e959f04666 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.118070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa3e2c-caca-4b92-95fd-09e959f04666 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.118379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa3e2c-caca-4b92-95fd-09e959f04666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.144608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15d70-e341-4f65-89f5-428b36c48c39 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.160770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:49.193848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.194774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.195128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.195479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.200091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa3e2c-caca-4b92-95fd-09e959f04666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.201763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa3e2c-caca-4b92-95fd-09e959f04666 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.203616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.204215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:49.207447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-12497a93-2f79-4a62-a45d-4ec910835ce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:49.232874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:49.233985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:49.235585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:49.238284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 349/696] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:49.239816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0164-55e0-42b2-b97f-ad10ad4fc59c None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.240384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0164-55e0-42b2-b97f-ad10ad4fc59c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.240877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a0164-55e0-42b2-b97f-ad10ad4fc59c None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.246840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 350/697] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:49.247821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0164-55e0-42b2-b97f-ad10ad4fc59c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.334609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 348/698] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:49.336422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.336717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.336996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.356423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a0164-55e0-42b2-b97f-ad10ad4fc59c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.357076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:49.358297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:49.395068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.395660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.395975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.396283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.397114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:49.397431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.398903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.411278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 351/699] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:49.412213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.449454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 349/700] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:49.450482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.456365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:49.487304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:49.546579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615a8be-1114-434f-b6de-2b94bce35422 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.564512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802032b-65ea-4c8c-9c46-f3cce23d3740 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.589042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.590182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.590790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.591115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.601293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.602029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.602424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.602836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.603855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=aef646744cb34d9eb6068cb54a31315e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:49.604235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.604876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.605773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.606422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.613131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 350/701] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/role_assignments?user.id=aef646744cb34d9eb6068cb54a31315e&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:49.613987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:49.646962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:49.647897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:49.648778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:49.648778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:49.648778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:49.648778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:49.648778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 352/702] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:49.655753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.795112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:49.823300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7dd03d-67a2-49ae-9b4b-ff32ea6af5ac None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.834974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:49.842806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443688c-bb5e-4ecf-ad28-1b9f5462bc4e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:49.867333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.868031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.868353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.868820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.869594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:49.869927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.871337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.887103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 353/703] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:49.891517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:49.892716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:49.892989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:49.893098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:49.893256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:49.909079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:49.910645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:49.931337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:49.932280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:49.933184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:49.933184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:49.933184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:49.933184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:49.933184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 351/704] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:49.939183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.003790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3cea-ee81-41ea-a460-246cf069ae02 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.043199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.044038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.044344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.044656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.052629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.054114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.061906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdbe99-6014-4f2a-a47c-45b5650b4e8e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-809bd142-0761-4392-be90-dd80803d4b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:50.070058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:50.077062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 354/705] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db19614-35b6-47c6-9743-3f9e5443c95d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.078002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db19614-35b6-47c6-9743-3f9e5443c95d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.079221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db19614-35b6-47c6-9743-3f9e5443c95d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.079221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 355/706] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:50.079221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db19614-35b6-47c6-9743-3f9e5443c95d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.087314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.106125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.106830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.107103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.107388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.108104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:50.108410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.109791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62343e-f0a3-4820-8366-0a306694dd9a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.124369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 352/707] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:50.125778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.126069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.126381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.146655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:50.148225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:50.151192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.218029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db19614-35b6-47c6-9743-3f9e5443c95d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.229309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 353/708] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:50.235036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.270409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.271473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.271963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.272440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.273445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:50.273965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.275685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.289763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 356/709] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:50.290995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.355952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.359510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91020cc-3eaa-49a5-baaf-7684cd43a442 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.396874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d95eaa-aa81-4f9b-8c2c-283a39e86666 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.400690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.400690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.400993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.401197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.401913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.403373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.413079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.430373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 354/710] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:57:50 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:50.431132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.438506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.440003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.440573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.441073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] PATH_INFO: `/v3/services/network` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.441870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.443388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5dd9a5e2-f992-4028-9019-b1002910a5fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:50.458877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:50.460027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:57:50.461044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:50.465516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 357/711] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:50 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:50.467210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923b5b-b35b-43f9-a7f7-01be89fde264 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.467619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923b5b-b35b-43f9-a7f7-01be89fde264 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.467976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26923b5b-b35b-43f9-a7f7-01be89fde264 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.474287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 358/712] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:50.474287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923b5b-b35b-43f9-a7f7-01be89fde264 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.585439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3cba7-99af-4c2f-9c0d-d611c88c72bf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.623313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26923b5b-b35b-43f9-a7f7-01be89fde264 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.637063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.637731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.638024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.639151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.639151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=572e1cbd83cb43c396cd474079633af7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:50.639618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.640893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c0e83-0a31-458b-aab1-5fec52e313de None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.649619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 355/713] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:50 2022] GET /identity/v3/role_assignments?user.id=572e1cbd83cb43c396cd474079633af7&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:50.651675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.651675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.651675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.669595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.679510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:50.680143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.680833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.681116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.681392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.682077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:50.682198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] RBAC: Adding query filter params (name=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:50.682473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.683902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.691347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 359/714] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:57:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:50.696600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.766634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.789385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 356/715] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:50.832755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:50.845476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbf360-359c-4b7f-92a6-c753357a5964 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:50.886868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:50.887781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:50.888228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:50.888660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:50.889530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:50.889982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:50.892054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:50.898492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 360/716] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:57:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:50.964658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bbe3c-0163-4ee5-a03a-9e4406d3de30 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:51.001612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:51.002736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:51.003207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:51.003647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:51.004461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:51.005999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:51.021804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:51.023014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:57:51.024097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:51.026805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 357/717] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jun 24 08:57:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:51.034338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:51.105574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.155712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1a1c9-099d-417b-84ef-193aecc10f00 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:51.194317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:51.195082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:51.195438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:51.195783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:51.196566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:51.196942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:51.198389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf818f-392c-4ac1-88bb-74e649410e10 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:51.203526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 361/718] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 08:57:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:51.210261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:51.277199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.345826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c61794-61bb-4fa9-aac6-68fe23f46c07 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:51.380338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:51.381004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:51.381289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:51.381567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:51.382307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:51.382620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:51.383987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6782f0-aea4-4a85-9522-d8a640e68fb7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:51.390175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 358/719] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 08:57:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:52.391656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97547-ba19-4744-b67a-f43bca27af7b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:52.392203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97547-ba19-4744-b67a-f43bca27af7b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:52.392203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97547-ba19-4744-b67a-f43bca27af7b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:52.393827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 362/720] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:52.399298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:52.399688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:52.399870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:52.420415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:52.421593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:52.511288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 359/721] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:52.535491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e97547-ba19-4744-b67a-f43bca27af7b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:52.640136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e97547-ba19-4744-b67a-f43bca27af7b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:52.668939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:52.675104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:52.675905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:52.676197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:52.676647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:52.687418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:52.694993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:52.695928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:52.696772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 363/722] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:52.702181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:52.758282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:52.814267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8091f2-8d5a-497a-a521-2329746da34a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:52.849518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:52.850192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:52.850501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:52.850781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:52.851533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:52.851840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:52.853202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:52.862243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 360/723] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:52.867946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:52.973559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a9d5c-da1e-44ac-ba43-f181b1df448e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.008932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.009734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.010021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.010324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.023464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:53.023464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:53.049422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:53.050418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:53.051425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:53.051425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:53.051425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:53.051425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:53.051425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 364/724] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:53.056285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.184914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b2968-2f53-457d-ae08-e7a53e73cb94 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.194655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:53.232172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.232762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.233045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.233323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.234053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:53.234386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:53.236289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d306d5-f07f-4ea2-a893-bdfb2fab0a06 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:53.252585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:53.258149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.269821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4f47-02a2-4851-93d3-bf0ef45dfc7b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.270110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4f47-02a2-4851-93d3-bf0ef45dfc7b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.270412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f4f47-02a2-4851-93d3-bf0ef45dfc7b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.275629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 362/726] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:53.276741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5e3e-3baa-44b0-abef-3d92cc3a501a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.277027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5e3e-3baa-44b0-abef-3d92cc3a501a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.277303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5e3e-3baa-44b0-abef-3d92cc3a501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.311659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d55c5e3e-3baa-44b0-abef-3d92cc3a501a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:53.313387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d55c5e3e-3baa-44b0-abef-3d92cc3a501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:53.325346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:53.398515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fa701-1d9f-46b7-bec5-8be46dbb0924 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.407383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 363/727] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:53.409546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a410dc-91ee-49b9-bf6a-d0ea7e2f5ee4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.410002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a410dc-91ee-49b9-bf6a-d0ea7e2f5ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.414495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a410dc-91ee-49b9-bf6a-d0ea7e2f5ee4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.416455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 364/728] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:53.427069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.427697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.428214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.432907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.433703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.433989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.434304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.446092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:53.446092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:53.459480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:53.459686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:53.460756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:53.461801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 365/729] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:53.462454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.463864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:53.546353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 365/730] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 08:57:53.546353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.571217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:53.574185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:53.583353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b9ae-618c-497a-b009-448daa4598fe None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.623920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292d1c-b29e-4eb3-b2d0-e5b9318fce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.624850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292d1c-b29e-4eb3-b2d0-e5b9318fce74 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.625133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292d1c-b29e-4eb3-b2d0-e5b9318fce74 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.625444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292d1c-b29e-4eb3-b2d0-e5b9318fce74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.636131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19292d1c-b29e-4eb3-b2d0-e5b9318fce74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-19292d1c-b29e-4eb3-b2d0-e5b9318fce74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:53.644505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:53.645443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:53.646338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 366/731] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:53.647052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02e54-1d4a-47a8-a2bd-95eb003edbbc None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.647721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02e54-1d4a-47a8-a2bd-95eb003edbbc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.647721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f02e54-1d4a-47a8-a2bd-95eb003edbbc None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.653069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 367/732] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:53.653069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02e54-1d4a-47a8-a2bd-95eb003edbbc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.658781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3bad3-ed23-4b6d-90e8-853e09fe9ed1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.694650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.695333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.695624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.696359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.697214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:53.697531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:53.699675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:53.723763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 366/733] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:53.723763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.764502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f02e54-1d4a-47a8-a2bd-95eb003edbbc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.802984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b93253-6191-4972-85f8-ce21e4efb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.803708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b93253-6191-4972-85f8-ce21e4efb4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.804343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b93253-6191-4972-85f8-ce21e4efb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.804631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b93253-6191-4972-85f8-ce21e4efb4b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.812681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:53.816584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b93253-6191-4972-85f8-ce21e4efb4b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a7b93253-6191-4972-85f8-ce21e4efb4b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:53.824197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:53.825337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:53.826420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:53.830361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 368/734] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:53.831607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.831898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.832180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.832374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd144de7-b7bc-4cc0-852d-b4c5a3c202ab None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:53.848759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:53.849946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:53.858309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:53.869588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:53.870292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:53.870584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:53.870861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:53.871670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:53.872000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:53.873384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:53.882383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 367/735] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:53.887501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:53.926308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 369/736] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:53.926308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.000219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe5b93-4c55-42da-9e68-5c43fa55206c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.024129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe07f4-670a-4d23-ace2-e8f29ef4f506 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.036646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99358510-1aa9-4454-8a50-d5d700383b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.037299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358510-1aa9-4454-8a50-d5d700383b72 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.037590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358510-1aa9-4454-8a50-d5d700383b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.037865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99358510-1aa9-4454-8a50-d5d700383b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.055310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.060810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.061475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.061759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.062037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.063344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:54.063652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.065010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.073085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 370/737] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:54.073879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.080739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.105868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99358510-1aa9-4454-8a50-d5d700383b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.107547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99358510-1aa9-4454-8a50-d5d700383b72 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.176555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ca2da-2b9b-4786-b375-2c8ccb88aa72 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.206250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 368/738] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:54.207904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d41e4-3e08-4d39-95ac-c76706a09de7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.208500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d41e4-3e08-4d39-95ac-c76706a09de7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.208927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d41e4-3e08-4d39-95ac-c76706a09de7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.211071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.211630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 369/739] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:54.211867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.212155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.212432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.212916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d41e4-3e08-4d39-95ac-c76706a09de7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.223598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.225054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:54.242426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:54.243478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:54.244587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:54.244587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:54.244587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:54.244587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:54.244587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 371/740] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:54.244587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.270565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.299973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.321340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d41e4-3e08-4d39-95ac-c76706a09de7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.344093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548f965-0882-48f0-acc1-a2f7d0af2d14 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.355434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.356104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.356397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.356677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.357394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.358786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.374172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 370/741] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:57:54 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:54.375692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.407523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.408377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.408665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.408969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.420126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.421643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-aff91220-325a-46df-a9ef-deb1268664da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:54.443551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:54.444839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:54.445955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:54.445955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:54.445955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:54.445955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:54.447765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 372/742] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:54.449147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.449441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.449720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.467832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:54.469627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:54.496214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ee91-c601-4af5-9f6e-579380c07846 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.505902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.536919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.538003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.538315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.538600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.546660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 373/743] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:54.547818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.552801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.555211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:54.574880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:54.575884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:54.576801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:54.576801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:54.576801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:54.576801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:54.576801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 371/744] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:54.577153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.589017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.661226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46377443-e448-49f1-8b13-a5d41924c343 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.682526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559a641-8f32-4c89-80d0-0e0feae6e0c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.696494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.697167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.697453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.697734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.698502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:54.698817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.700211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.711770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 374/745] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:54.716641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.717695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.718402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.718691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.718999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.719733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:54.720040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.721400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.738278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 372/746] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:54.738278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.759566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.819915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.827513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd09b3-8c14-455f-a03d-d8347edc5495 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.839773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b6ce2-da45-4512-8788-f199df76dd6e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:54.863098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.863769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.864058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.864341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.865061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.866731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.877856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:54.878551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:54.878839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:54.879116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:54.879865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:54.880170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:54.881498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:54.883943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 375/747] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:57:54 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:57:54.887179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:54.895198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 373/748] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:54.896258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.000089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:55.025057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf46e9-77e7-4467-b943-81bfde10d6e7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.045657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb3cfb-0d4c-4261-8135-82518cc91015 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.065729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.067425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.067998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.067998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.076568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.078060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.085713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.086566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.086852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.087573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:55.094347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:55.095290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:55.096249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 374/749] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:55.096863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.101250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.103011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:55.124082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:55.125102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 376/750] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:57:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:55.126613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.143615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:55.227704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300832a7-d79a-488e-8c06-c99fe898e675 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.254524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c93f40-0e1e-43e9-9b32-97e3d63b4cd8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.275231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.276307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.276596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.276875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.287042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.288779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.288892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.289540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.289828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.290104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.291023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:55.291334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.291453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:55.292747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:55.307556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:55.308484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:55.309395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 375/751] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:55.310375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.320732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 377/752] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:55.321587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.402603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:55.440046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30568a-9204-4439-8671-dc2d951bb723 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.441607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158ca3c-fea9-4e78-942c-ef67b08cbc08 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.481011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.481772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.482067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.482398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.483300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:55.483610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.485480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.486312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.487208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.487694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.488173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.489233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:55.489758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.491659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.501792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 378/753] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:55.501792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.516668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 376/754] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:55.517979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.585158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:55.638486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cd95b-4519-4973-8343-f93eaedb2ed2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.639593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a2ed2-3e22-4ddc-b2e9-4bcb41ece424 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.675679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.676269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.676559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.676836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.677298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:55.677691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=aef646744cb34d9eb6068cb54a31315e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:55.678166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.679432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.691717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 377/755] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/role_assignments?user.id=aef646744cb34d9eb6068cb54a31315e&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:55.692317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.692734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.693580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.694015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.694475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.708930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.710720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:55.733301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:55.735476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:55.736718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:55.736718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:55.736718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:55.736718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:55.738976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 379/756] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:55.745600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.864455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a62a8-7231-4412-ad55-c792a943ebf6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.924405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.925027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.925315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.925593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.926405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:55.926665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.928047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.935393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df887-a133-49c2-aaf2-87f173d0ba12 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.941170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 380/757] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:55.949356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.974688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:56.006732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:56.026965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:56.027638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.027924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.028204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.077291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e1ea-712d-4ec9-9bdd-26b2888e5df0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:56.116925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:56.118238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.118771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.119248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.127961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:56.129732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:56.145147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:56.146114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:56.147153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:56.149830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 381/758] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:56.156417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:56.266139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:56.277630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e0198-851d-43a1-ac08-b880a4046a71 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:56.288281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:56.289506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:56.328243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:56.329915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.330442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.330923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.332062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:56.332587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:56.334233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:56.349172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 382/759] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:56.355042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:56.461584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edb94-531a-4c5e-befc-59aa565b3094 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:56.498259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 378/760] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:56.503758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:56.504677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73f770-7f6e-4423-8bbe-4a3241a4f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:56.505932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73f770-7f6e-4423-8bbe-4a3241a4f623 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.506498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73f770-7f6e-4423-8bbe-4a3241a4f623 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.506996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73f770-7f6e-4423-8bbe-4a3241a4f623 None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/572e1cbd83cb43c396cd474079633af7/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.509247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73f770-7f6e-4423-8bbe-4a3241a4f623 None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=572e1cbd83cb43c396cd474079633af7, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:56.511034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73f770-7f6e-4423-8bbe-4a3241a4f623 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:56.528255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 383/761] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:57:56 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/572e1cbd83cb43c396cd474079633af7/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:57:56.567174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8317ab-b1a7-4a03-b732-c42e62a74aa7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.567869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8317ab-b1a7-4a03-b732-c42e62a74aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.568398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8317ab-b1a7-4a03-b732-c42e62a74aa7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.571101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 384/762] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:56.574091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:56.583850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.584611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.585238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.618251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:56.620512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:56.642862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:56.665579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe325-bdca-476b-ad81-25f6e38afb1f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:56.705697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:56.706595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:56.706891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:56.707489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:56.718756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:56.720465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:56.747307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:56.748270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:56.749194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:56.749194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:56.749194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:56.749194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:56.749428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 379/763] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:56.764776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:56.783443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 385/764] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:57:56.808752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:56.871513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:56.924647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916c070-802c-4085-9065-0fb3e4750166 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:56.967931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fce80-76ab-466d-af28-156f63a4e086 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.005208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.006281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.006668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.007094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] PATH_INFO: `/v3/services/network` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.007860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.009337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:57.026387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:57.027444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:57.028290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 386/765] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:56 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:57.035204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.036229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.037200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.037489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.038910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.039664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:57.039978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.043260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.069718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 380/766] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:57.070375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.078204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.167982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e96fe-a7bb-4922-862f-0e5701e0d8ef None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.191434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc0266-e128-4894-bc6c-53aa89a99a8d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.205987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.206956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.207095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.207357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.208099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] RBAC: Adding query filter params (name=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:57.208381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.209751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b4ea-1263-4c16-93a5-95be3884a377 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.215144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 387/767] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:57.216385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0d33-5b0b-44dc-859d-6133190fb7c8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.216680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0d33-5b0b-44dc-859d-6133190fb7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.217097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0d33-5b0b-44dc-859d-6133190fb7c8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.222496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 388/768] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:57.222496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0d33-5b0b-44dc-859d-6133190fb7c8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.233174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.234185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.234702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.235148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.237254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.243208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.244955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-293f2b9f-2d62-4aed-bfc4-63e72acb2214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:57:57.260291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:57.261377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:57:57.262415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:57.269254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 381/769] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:57.270791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.271257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.271699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.288543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:57.289907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:57.308392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.334346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0d33-5b0b-44dc-859d-6133190fb7c8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.369585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.370082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 382/770] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:57:57.370287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.370802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.371149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.371702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.372003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:57.372450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.373828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.379991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 389/771] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:57.387839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.494892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ed124-55a5-4fb8-8de2-3064bc36d250 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.495832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39a07b-f68b-46c9-87bc-5e3899b4d6f3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.521854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.535902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.536575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.536874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.537143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.537936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:57.538269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.539739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.543251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.544286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.544575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.544854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.545655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] RBAC: Adding query filter params (interface=public, service_id=f3fa0470512b478fa9e3fe2f07d3ac2f, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:57.545972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.547923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.555989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 383/772] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:57.557062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.565980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 390/773] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/endpoints?service_id=f3fa0470512b478fa9e3fe2f07d3ac2f&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:57.565980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.577035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.673348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71136a-f57e-461b-b4f8-abbeaf3c99b1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.676865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc34c1a-9b7e-4007-9c0f-5235328f9ac2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.710135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.711152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.711532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.712011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.712777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.714359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.715828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.716768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.717296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.717728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.718756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=6948dca9b9bf40ed8e2195c463a49d84) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:57.719250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.720814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:57.728062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:57.729219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:57:57.730294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:57.731841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 391/774] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/role_assignments?user.id=6948dca9b9bf40ed8e2195c463a49d84&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:57.733053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.735773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 384/775] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:57.745634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:57.842390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.894861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:57.928490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633348f-64e2-48f8-9cbc-400e9b8e3a13 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:57.965878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:57.966823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:57.967600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:57.968178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:57.969564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:57.971346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:57.982530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 392/776] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:57.988415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2ff70-3081-42e7-b03e-a7c8bc9601b8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.077937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.079218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.079504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.079783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.080513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:58.080822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:58.082256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3775274-92ce-4e27-abec-d61af4c15b4e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:58.087845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 385/777] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 08:57:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:58.093300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:58.098549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f04a-e8f1-44f6-a6ca-2b856fb5dff1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.098840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f04a-e8f1-44f6-a6ca-2b856fb5dff1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.099124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f04a-e8f1-44f6-a6ca-2b856fb5dff1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.100898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 386/778] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:57:58.106382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.106673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.106957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.136390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:58.140044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:58.236009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 387/779] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:57:58.243943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f522a5a-9918-4e9c-9fce-6d6b680063c7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.264781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:58.285413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.286255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.286668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.287154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.288042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:58.288405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:58.289882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:58.291412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:58.304350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 393/780] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:58.309882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:58.330483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:58.442518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea4401-df42-4ee3-99d2-486fec74ba16 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.478772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336849-5981-441f-84e6-c5c42cb77cd6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.504221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.506338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.506623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.506898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.528172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:58.536402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:58.537303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:58.538136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:58.545618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 388/781] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:58.548235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.548910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.549196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.549476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.550300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] RBAC: Adding query filter params (interface=public, service_id=89d24751bbb64c399f865cffdbaecdac, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:58.550618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:58.552042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:58.553958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:58.561574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 394/782] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/endpoints?service_id=89d24751bbb64c399f865cffdbaecdac&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:58.567026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:58.669533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:58.697470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07666b25-ef6d-4fee-859a-cc55faa9aef5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.709253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:58.733675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.734554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.735614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.735614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.742438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:58.742438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:58.742438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:58.747793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 389/783] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:58.754278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:58.780751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42a717-5e73-4c11-a50e-0782df80860a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.854551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.855223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.855508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.855785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.856471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:58.857834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:58.872743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 395/784] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/services => generated 772 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:58.915964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d8a5b-520a-475f-b1da-11507eae14a2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:58.951956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:58.952690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:58.952976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:58.953818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:58.965725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:58.967248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cdded780-d08b-4043-9d3b-951aee32a4af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:58.986852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:58.988016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:58.989066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:58.989066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:58.989066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:58.989066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:58.989066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 390/785] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:58.994577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.100337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7119dd-b41e-4462-843b-21665b1a8582 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.100696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7119dd-b41e-4462-843b-21665b1a8582 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.100896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7119dd-b41e-4462-843b-21665b1a8582 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.102452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 391/786] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:57:59.107850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.108493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.108987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.128121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:59.129612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:59.134750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f213-fc20-48be-9721-8b467f79b001 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.144261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.173188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.182496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.183290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.183680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.184059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.184891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:59.185675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:59.186906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:59.202397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 396/787] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:59.210191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.220911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 392/788] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:57:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:57:59.248425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.347445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4ec92-0c78-475f-be5e-dbc8ee1d62d8 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.354653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403fba0-2fc7-413f-8028-f6347344f8cb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.391962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.393141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.393636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.394181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.405151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:57:59.414045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:59.415066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:57:59.415936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:59.418991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.419824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.420199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.420378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.420799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 393/789] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:57:59.427896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.443161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:59.444638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:59.454048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:57:59.473899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:59.475123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:57:59.476289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 397/790] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:59.483155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.569431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6584f91-efd7-4e25-aa95-3f891c6482eb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.574828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.615373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.616040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.616576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.616851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.618957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:59.618957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:59.619416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:59.628105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 394/791] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:57:59.633452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.664779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f771e-4964-4a0e-a2d3-5514079e5032 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.703016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.740526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52008817-945b-4130-ad06-7f3c37d83dd7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.776264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.777062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.777346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.777622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.788328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.789006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.789288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.789563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.790434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:57:59.790743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:59.792171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:59.799765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:59.801211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:59.823671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 398/792] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:57:59.829529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:57:59.832198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:57:59.833091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:57:59.833974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:57:59.833974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:57:59.833974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:57:59.833974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:57:59.836790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 395/793] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:57:59.843589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:59.941108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69d4a-4c20-4a3e-9ea7-0d91710f9bd5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:59.943682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.977838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:59.978685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:59.978965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:59.979238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:59.991461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:59.992836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:00.012450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:00.013425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:00.015411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:00.015411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:00.015411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:00.015411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:00.015411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 399/794] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:00.026421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.084588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157e67b-ef6b-47ce-99d0-b99d5dde0baf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.106251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.124902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.126118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.126425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.126699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.127691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:00.127998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.130270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a368d-3c4f-43c0-a074-3523cd1f3c91 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.150387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 396/795] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:00.152076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915262-bc10-4d2e-987d-28ffdbf5c56d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.152364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915262-bc10-4d2e-987d-28ffdbf5c56d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.152640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915262-bc10-4d2e-987d-28ffdbf5c56d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.154049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 397/796] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:00.158700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915262-bc10-4d2e-987d-28ffdbf5c56d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.171191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6818-15b2-47a0-a506-12898cbc44db None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.208151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.209359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.209359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.209359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.210090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:00.210439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.211894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383b769-9a69-475c-9ee5-f8465d99b4a7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.228207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 400/797] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:00.228207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.228207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.228207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.243432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:00.244550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:00.256572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.303332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915262-bc10-4d2e-987d-28ffdbf5c56d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.326459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 401/798] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:00.327389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.344421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.346080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.346621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.347118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.357790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.360074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:00.380511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:00.381501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:00.382539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:00.388780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 398/799] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:00.388780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.437078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.471162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed51d-b746-4c03-a0e9-820e63100689 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.498968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018598db-5c2b-4cc7-9b19-4389fc0b66cb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.523101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.524902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.525663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.526151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.533869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.535618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.535826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9384dd-fcb8-4fe6-83be-a6b6e58b8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.536677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9384dd-fcb8-4fe6-83be-a6b6e58b8c93 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.536963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9384dd-fcb8-4fe6-83be-a6b6e58b8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.537294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9384dd-fcb8-4fe6-83be-a6b6e58b8c93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.548342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9384dd-fcb8-4fe6-83be-a6b6e58b8c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:00.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:00.550811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:00.551728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:00.555883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 402/800] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cc9384dd-fcb8-4fe6-83be-a6b6e58b8c93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:00.556385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:00.557282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:58:00.558128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:00.560176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.560260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 399/801] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:00.560260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e032-614f-4f97-8ad3-ed5f5c0aa037 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.560260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e032-614f-4f97-8ad3-ed5f5c0aa037 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.560260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90e032-614f-4f97-8ad3-ed5f5c0aa037 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.562272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 400/802] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:00.562272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e032-614f-4f97-8ad3-ed5f5c0aa037 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.573437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.670039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104fba6-7996-4f72-a8ef-6eba79e8d446 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.674860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.678775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90e032-614f-4f97-8ad3-ed5f5c0aa037 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.708122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.708791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.709100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.709360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.710193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:00.710532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.711963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.714077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.715318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.715318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.715318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.716092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:00.716405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.717804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159b28d-aede-46cc-98f4-626ef9daa437 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.729504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 403/803] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:00.730322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.737069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 401/804] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:00.738539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.738983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.739265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.756998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:00.758174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:00.807407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.828614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 402/805] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:00.829262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.860468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ec2fe-4c4c-4ab6-ba0b-052bf8d77d49 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.897332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.897983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.898354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.898637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:00.899386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:00.899694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:00.901066 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:00.914209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 404/806] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:00.914209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:00.931799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:00.944045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1277ba-8f20-4ed8-b6be-c975a35459cd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:00.980158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:00.980932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:00.981215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:00.981492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.016931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c87c9-884c-4361-a85f-dea3fcdd218c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.047789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.057317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.058203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.058513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.058787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/aef646744cb34d9eb6068cb54a31315e/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.060753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=aef646744cb34d9eb6068cb54a31315e, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.062034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.062314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.063563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.075826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 405/807] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:58:00 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/aef646744cb34d9eb6068cb54a31315e/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:58:01.076610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.183852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.190141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765afccd-a349-46bf-b30b-7d38f922360d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.198617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 403/808] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:01.199893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.232951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.233802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.234090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.234430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] PATH_INFO: `/v3/services/network` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.235661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.237038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:01.250902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:01.251934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:01.252781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 406/809] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:01.253573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.319746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.327503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df245c66-f3b4-441d-800b-c74a2af35bcf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.365940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.367350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.367905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.368488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.379394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843525d1-7ff0-40ec-ac36-263585d69f84 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.379979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.381431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:01.400297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:01.401341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:01.402816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:01.402816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:01.402816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:01.402816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:01.402816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 404/810] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:01.402816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.420068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.420863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.421147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.421419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.431967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.433431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.451555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-78baac7c-13ac-4a78-bdb7-ad922a5472d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:01.453835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:01.454755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:01.455687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:01.455687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:01.455687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:01.455687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:01.455687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 407/811] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:01.456767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96317b8-00bb-41cc-b3aa-bfaebacaf47d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.457063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96317b8-00bb-41cc-b3aa-bfaebacaf47d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.457347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96317b8-00bb-41cc-b3aa-bfaebacaf47d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.463037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 408/812] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:01.463037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96317b8-00bb-41cc-b3aa-bfaebacaf47d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.516735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad4b90-71b9-49bb-a490-b33f31e50ed4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.553374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.554044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.554358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.554635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.555345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:01.555652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.557010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.561512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 405/813] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:01.562322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.579491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96317b8-00bb-41cc-b3aa-bfaebacaf47d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.581477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.619387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.620343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.620847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.621312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.622052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:01.622389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.623754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950ba3f-3bf2-4eeb-80e8-7407fc8ee951 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.636164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 409/814] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:01.637393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.637681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.637955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.655630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:01.657352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:01.675090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0c0ab-8570-4e4d-bd76-e7396c1f53f6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.683449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.715027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.715804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.715997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.716275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.717003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:01.717313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.718700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.727391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 410/815] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:01.728238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.748550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 406/816] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:01.748550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.840294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.850779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f05b7-4fc7-41e2-89f9-0f367e269d02 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.860265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0fb3e-def1-4015-a608-d530639750e1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:01.892801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.893464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.893750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.894011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.894746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:01.895050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.896403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.901256 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 411/817] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:01.902011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.907395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:01.908216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:01.908504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:01.909052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:01.917584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:01.919060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:01.933882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:01.934851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:01.935801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 407/818] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:01.936392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:01.964460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.020423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700efad6-8711-406f-86a6-57f40729d5b2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.050442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ac3a5-91f2-48db-b13d-dc023b05e693 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.056553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.057357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.057644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.057917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.064740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.066187 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:02.080718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:02.081628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:02.082590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 412/819] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:02.083079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.091974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.093133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.093615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.094696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.095749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.097405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.102725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:02.111532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:02.112694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:58:02.113736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:02.117795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 408/820] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jun 24 08:58:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:02.118644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.196415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eed1fb-578a-4f53-8851-a4ba0b19cfab None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.213688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.226706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd6ab-b7cd-4836-ae51-ae0965d3b2b1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.233774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.235026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.235318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.235647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.236406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.237793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.260574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 413/821] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:02.261407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.286672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.287569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.287936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.288316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.289326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:02.289713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.291572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.317486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 409/822] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:02.317486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.361177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.401339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e2aa9-1c4a-4a1b-8acf-817eb614b6d7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.444614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.445283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.445564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.445841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.446666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:02.446974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.448414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.455899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f21c-427c-4298-b31a-bac716fcf484 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.497130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.497819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.498093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.498402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.499126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:02.499431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.501383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.509330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 410/823] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:02.510303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.524845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.589331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 414/824] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:02.589331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.630508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987ddf1-e7c9-4505-a200-f39c186a5e01 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.666147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.667007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.667294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.667572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.678504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.680039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.694630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07f1cc-de29-40d2-bf03-05b195aa3ced None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:02.698173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:02.699070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:02.704955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:02.704955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:02.704955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:02.704955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:02.704955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 411/825] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:02.704955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.729580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.738728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.739544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.739871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.740146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.740814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:02.741377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.742910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.752863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 415/826] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:02.752863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.773131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:02.817611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bcc4c-e254-4ee2-b58d-8e95355c793d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.854600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.855265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.855550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.855829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.856664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=572e1cbd83cb43c396cd474079633af7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:02.856777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb0a0f-21d9-46b4-bca9-c44c33190b8f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:02.856975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.858421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.864835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 412/827] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/role_assignments?user.id=572e1cbd83cb43c396cd474079633af7&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:02.865435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:02.905970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:02.906423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:02.907227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:02.907500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:02.908267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:02.908536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:02.909917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:02.928989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 416/828] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:02.929828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.005325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:03.011940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6a75-f945-47bf-9cce-21f253a6fabe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.045384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:03.063367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36838c-6b26-4667-bf56-b2930825fb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.064040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36838c-6b26-4667-bf56-b2930825fb57 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.064330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36838c-6b26-4667-bf56-b2930825fb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.064608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36838c-6b26-4667-bf56-b2930825fb57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.065532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36838c-6b26-4667-bf56-b2930825fb57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:03.067863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36838c-6b26-4667-bf56-b2930825fb57 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:03.073557 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23f46-0ba6-4df0-8ece-e4952facdc8f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.092786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 413/829] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:03.131225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.132067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.132346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.132618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.140469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:03.142668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:03.158586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:03.159742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:03.161267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 417/830] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:03.161778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05d92-e57c-4f86-a8ef-5465c551ae35 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.161778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05d92-e57c-4f86-a8ef-5465c551ae35 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.161778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05d92-e57c-4f86-a8ef-5465c551ae35 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.162944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 414/831] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:03.167340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.169960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.170718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.170718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.189148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:03.190407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:03.282611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 415/832] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:03.302675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.305650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6134069-7284-4907-9909-baa9c1e59856 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.320230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:03.356691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.357874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.358410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.359226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.360518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:03.361218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:03.363159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:03.380555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 418/833] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:03.386616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.428802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e978b7-1612-44cb-81f6-1679ff927674 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.442605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:03.465967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.467343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.468036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.468738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.480707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:03.489117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:03.490037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:03.490910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:03.498386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:03.499509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.506201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfeaf7-a273-47d3-ad23-d34e56ed557a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.541824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.543078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.543078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.543336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/6948dca9b9bf40ed8e2195c463a49d84/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.558813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=6948dca9b9bf40ed8e2195c463a49d84, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:03.560237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:03.582286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 419/835] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:58:03 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/6948dca9b9bf40ed8e2195c463a49d84/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:58:03.628165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8663010-2601-4915-b1a8-f786e51c83a2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.667420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.668105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.668384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.668658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.669422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:03.669727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:03.671166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:03.681100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 417/836] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:03.686501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.714894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:03.803106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1200-f1b8-41fc-b4c9-c074d54505a9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:03.838911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:03.839695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:03.839971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:03.840239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:03.850746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:03.852185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:03.870101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:03.871089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:03.872414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:03.872414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:03.872414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:03.872414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:03.872414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 420/837] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:03.877719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:03.910596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:03.981938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5673-dceb-4612-a22d-d59d1fc7004a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:04.016687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:04.017347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:04.017628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:04.017900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:04.018650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:04.018951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:04.020423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:04.033487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 418/838] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:04.038902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:04.116851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:04.143530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee16d04-1de9-495f-a380-b650382e7db5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:04.180144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:04.181325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:04.181811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:04.182315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:04.189986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:04.191678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:04.207765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:04.208755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:58:04.209712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:04.212366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 421/839] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:04.218506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:04.313693 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:04.322447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdf130-1ef7-4626-96eb-adb55de50e34 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:04.356952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:04.357623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:04.357902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:04.358175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:04.359039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:04.359904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:04.361431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:04.379863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 419/840] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jun 24 08:58:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:04.385438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:04.492075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185d92c-2556-4235-bcea-57207a63b9ff None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:04.527657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:04.528614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:04.529104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:04.529602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:04.533052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:04.599332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:04.600795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:04.706690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 422/841] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:04.708482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:04.815261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1aa92-78da-4600-9138-5878373aae5b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:04.851586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:04.852769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:04.853271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:04.853757 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:04.866470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:04.868278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e46b1ca5-ea73-4db9-a429-22fb981b5422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:04.886512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:04.887868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:04.888767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:04.888767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:04.888767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:04.888767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:04.891630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 420/842] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:04.899138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:04.932279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.000379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d1409-4675-4e75-ae81-692f88098427 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.035844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.036519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.036935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.037369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.038102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:05.038444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.038663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e36e4-f9c5-4ff7-a9e6-ad425932dae7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.038954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e36e4-f9c5-4ff7-a9e6-ad425932dae7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.039231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e36e4-f9c5-4ff7-a9e6-ad425932dae7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.039810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.040868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 421/843] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:05.046029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.046342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.046717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.056292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 423/844] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:05.057529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.062622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.066772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:05.068012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:05.149639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 422/845] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:05.153745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.160813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501628-7ff3-4ede-8d07-5fac8e3dc755 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.168068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.196024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.196822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.197106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.197385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.204477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.206249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:05.220474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:05.221583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:05.222701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:05.226543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 424/846] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:05.227806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.278173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8e1e-e478-4439-b090-a8439ea0adf8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.310591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.317137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.317924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.318516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.318516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.319145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.320535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0f1dfd86-09b7-4fd4-a455-ab0b2e6ca0a6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:05.332679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:05.333612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:05.334513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 423/847] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:05.336004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2485b-b562-4aa2-b91d-7834c01c37e4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.336004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2485b-b562-4aa2-b91d-7834c01c37e4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.336004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2485b-b562-4aa2-b91d-7834c01c37e4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.337020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 424/848] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:05.341476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2485b-b562-4aa2-b91d-7834c01c37e4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.342361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d546-0374-424b-a5f4-8df314305e01 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.379382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.380039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.380318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.380596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.381380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:05.381687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.383133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca65cbe-7c53-43b9-a943-ad297c31316f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.395396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 425/849] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:05.396485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.396775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.397052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.413554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:05.414688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:05.425282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.454482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2485b-b562-4aa2-b91d-7834c01c37e4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.494306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 426/850] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:05.494498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.494498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.494682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.494768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.494768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.494768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:05.494768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.494768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.504925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 425/851] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:05.511447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.570805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.603598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56087154-c74f-491b-9bf9-7afaa7326b05 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.613452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52908275-e49f-49e2-bca6-489d121bf4e1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.641800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.642901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.643189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.643465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.644378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=aef646744cb34d9eb6068cb54a31315e) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:05.644786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.646597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.647682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.648341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.648626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.648902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.649610 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:05.649923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.651299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77923f2c-ad6f-4402-98a3-5b379a9a7df4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.653365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 427/852] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/role_assignments?user.id=aef646744cb34d9eb6068cb54a31315e&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:05.654587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.665217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 426/853] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:05.671548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.783602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1456036-0596-4434-845b-6c29eb14aaa2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:05.812180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ed68b-ae6c-410f-bd48-c16c30dca571 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.812563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ed68b-ae6c-410f-bd48-c16c30dca571 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.813359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ed68b-ae6c-410f-bd48-c16c30dca571 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.815155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 427/854] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:05.820878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.821160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.821439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.826164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:05.827017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:05.827298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:05.827572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:05.828792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:05.830203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:05.840129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:05.841703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:05.843344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:05.844977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:05.845821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 428/855] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:05.852562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.932989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 428/856] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:05.937984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.961386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:05.976630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd8c6e-d4ef-4612-a0b0-8ed6ead9075e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.019748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:06.020505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.021355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.021842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.022294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.023148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:06.023594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:06.025135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:06.033094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 429/857] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:06.038861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:06.068768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af6b05-5aab-4dbe-9da4-c177961edbfc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.104480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.105299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.105653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.106001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.117761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:06.126410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:06.127367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:58:06.128215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:06.132435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 429/858] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 08:58:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:06.133342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:06.154246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0caeb11-d43f-440d-bce3-7d0d8c93c292 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.200705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.201727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.202155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.202604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.204017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:06.204709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:06.206864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:06.210920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:06.226773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 430/859] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:06.252400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70638583-5d1f-4a0f-b567-80288dd4b856 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.273515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:06.299812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.300908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.301404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.301895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.302914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:06.303447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:06.305092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:06.316023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 430/860] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 08:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:06.321476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:06.439295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34ee6-224d-4016-b716-04427a6f1761 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.477222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.478407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.478917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.479397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.491873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:06.493631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:06.512255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:06.513167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:06.514075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:06.514075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:06.514075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:06.514075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:06.516347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 431/861] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:06.523344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:06.743535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3fdb4-e2d0-4871-829e-a31befa2da2c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.783345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.784402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.784908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.785386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.786353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:06.786867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:06.788437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:06.801055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 431/862] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:06.807332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:06.872191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:06.921591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce30c37-d7c7-4a15-97d0-9444cee9ca73 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:06.957227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:06.958062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:06.958389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:06.958662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:06.968047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:06.970042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:06.985763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:06.986778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:06.987714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 432/863] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:58:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:06.993238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:07.034979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:07.104119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2905219-4dc5-48f4-adf6-816b7e22d5b6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:07.139135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:07.140097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.141126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.141608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:07.142671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:07.143208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:07.144944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:07.169299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 432/864] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 08:58:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:07.175127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:07.274255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6cf99-f942-4662-9d93-334219697abe None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:07.287630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:07.308655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:07.309306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.309586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.309858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:07.376865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:07.378339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:07.484855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 433/865] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:07.490137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:07.588653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:07.597521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0d908-45db-4344-b9a2-c8da8d16851f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:07.632878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:07.633677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.633954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.634248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:07.644900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:07.646426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b0b2d52a-4d44-4323-a5bc-3cc805f510a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:07.664379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:07.665274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:07.666196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:07.666196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:07.666196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:07.666196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:07.666196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 433/866] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:07.671274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:07.686713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:07.772635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d10a4c-3b6f-446d-bc73-b7d2e91eee7a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:07.793770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90402c81-e8bd-4cb9-acb2-7dabf3a10da8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.794059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90402c81-e8bd-4cb9-acb2-7dabf3a10da8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.794352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90402c81-e8bd-4cb9-acb2-7dabf3a10da8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:07.795946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 434/867] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:07.800955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.801404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.801689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:07.816779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:07.817864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.818412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.818740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:07.819109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:07.819936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:07.820253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:07.820764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:07.822463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:07.835815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 434/868] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:07.841410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:07.910047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 435/869] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:07.926552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:07.934383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:07.960328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8155a-ded2-4cfa-b2f1-705c46498e30 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:07.996217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:07.997016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:07.997296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:07.997570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.005101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.006617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-82e84bc4-f399-48ca-9eb6-5ddf33ea57aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:08.021375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:08.022362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:08.024207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:08.024730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:08.025129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 435/870] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:08.028406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d28c-50a9-49a1-9981-a55e5f232182 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.028689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d28c-50a9-49a1-9981-a55e5f232182 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.028974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62d28c-50a9-49a1-9981-a55e5f232182 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.030578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 436/871] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:08.031916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d28c-50a9-49a1-9981-a55e5f232182 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:08.053714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745ee64-c163-452a-9507-e47c4445ba18 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.090606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25c6d8-d5b0-4a97-a4f8-0af4796a5f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.091553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c6d8-d5b0-4a97-a4f8-0af4796a5f45 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.091972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c6d8-d5b0-4a97-a4f8-0af4796a5f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.092407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25c6d8-d5b0-4a97-a4f8-0af4796a5f45 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.093278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c6d8-d5b0-4a97-a4f8-0af4796a5f45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.095209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25c6d8-d5b0-4a97-a4f8-0af4796a5f45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.114476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 436/872] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:07 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:58:08.114476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.114476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.114476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.138237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:08.141220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:08.162075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62d28c-50a9-49a1-9981-a55e5f232182 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.192452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:08.201249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.202180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.202737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.203794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.204768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:08.205220 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.207028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.220886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 437/873] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:08.229690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 437/874] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:08 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:08.229881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:08.253732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:08.330348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:08.348463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3d574-5aef-4485-84ae-71a43e361d57 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.382520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c2e5-a98a-4165-a817-421e0e1c987e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.385051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.386625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.386910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.387186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.388034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=6948dca9b9bf40ed8e2195c463a49d84) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:08.388349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.389784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.397706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 438/875] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:08 2022] GET /identity/v3/role_assignments?user.id=6948dca9b9bf40ed8e2195c463a49d84&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:08.428246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.429333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.429784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.430199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.431052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.432621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-05bf45c7-5422-4180-9890-631bf47c9817 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:08.446069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:08.447379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:08.448428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:08.451323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 438/876] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:08.457807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:08.467479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03ca4-65f5-4de1-af59-c5b0bf013f0e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.467910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03ca4-65f5-4de1-af59-c5b0bf013f0e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.468309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03ca4-65f5-4de1-af59-c5b0bf013f0e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.474583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 439/877] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:08.476370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.476863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.477148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.496377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:08.497748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:08.521152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:08.575991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157cd22-a8a3-477f-b0d0-44e80eab8923 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.576329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 440/878] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:08 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:08.600485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:08.614720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.615516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.615898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.616541 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.618173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:08.618602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.620064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.625769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 439/879] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:08.631757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:08.670904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:08.723346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cdc22-0e8d-453f-9bc2-040333ec435e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.757478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e1786-fb43-4648-a377-c68e183b67ee None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:08.775141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61781e0-cd75-4a8a-94e7-79f8d3b90d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.776036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61781e0-cd75-4a8a-94e7-79f8d3b90d2e None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.776496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61781e0-cd75-4a8a-94e7-79f8d3b90d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.776919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61781e0-cd75-4a8a-94e7-79f8d3b90d2e None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.777476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:08.778367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61781e0-cd75-4a8a-94e7-79f8d3b90d2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.780126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61781e0-cd75-4a8a-94e7-79f8d3b90d2e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.793502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:08.794273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:08.794662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:08.795009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:08.795793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:08.796172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:08.798131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830aaf39-32f3-47bb-8d1f-a66eeff9432c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:08.802561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 441/880] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:08 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:58:08.809908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 440/881] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:10.305136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdc33-c463-472a-9075-b75b6133ae42 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.305620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdc33-c463-472a-9075-b75b6133ae42 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.305620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafdc33-c463-472a-9075-b75b6133ae42 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.307265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 442/882] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:10.312580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.313010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.313191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.330316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:10.331506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:10.411067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 441/883] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:10.434376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdc33-c463-472a-9075-b75b6133ae42 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:10.539679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafdc33-c463-472a-9075-b75b6133ae42 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:10.561277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:10.576164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:10.576986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.577265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.577538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.578238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:10.579598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-96734b4c-9211-4ccb-88a8-36b5a59645af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:10.591787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:10.592730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:10.594544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 443/884] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jun 24 08:58:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:10.599679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:10.607871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bc835-715e-403b-abba-fc113f4c2e8b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.608178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bc835-715e-403b-abba-fc113f4c2e8b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.608455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bc835-715e-403b-abba-fc113f4c2e8b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.610622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 444/885] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:10.617526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.617896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.618281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.635753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:10.636938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:10.715464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 445/886] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:10.720660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48060e99-0392-4cc3-ae59-9525245dfdb2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:10.728460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:10.735354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:10.759995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:10.760980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.761463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.761938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.762892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:10.763399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:10.764978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:10.771058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 442/887] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:10.776800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:10.844787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19d17b-75de-43f4-8d61-1634d4ec5150 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:10.859520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:10.882533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90189de4-57b2-4451-9bf6-0b36a7bfcdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:10.883343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90189de4-57b2-4451-9bf6-0b36a7bfcdfe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.883623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90189de4-57b2-4451-9bf6-0b36a7bfcdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.883929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90189de4-57b2-4451-9bf6-0b36a7bfcdfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.885032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecb473-7526-4c4c-b2d4-63b54ff92fd7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:10.895241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90189de4-57b2-4451-9bf6-0b36a7bfcdfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-90189de4-57b2-4451-9bf6-0b36a7bfcdfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:10.903290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:10.904306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:10.905151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 446/888] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 08:58:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:10.906550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ebe0b-753f-43b4-aaef-0f13fd190c7f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.906550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ebe0b-753f-43b4-aaef-0f13fd190c7f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.906725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ebe0b-753f-43b4-aaef-0f13fd190c7f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.908010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 447/889] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:10.912595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ebe0b-753f-43b4-aaef-0f13fd190c7f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:10.929658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:10.930350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.930637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.930912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.931623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:10.931932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:10.933287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7bee0-14ea-4864-a0a9-036194a3b045 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:10.939043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 443/890] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:10.940067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:10.940353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:10.940625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:10.956622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:10.957792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:10.985987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.034945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ebe0b-753f-43b4-aaef-0f13fd190c7f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.042412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 444/891] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:11.042412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.076962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.077629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.077944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.078737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.079481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:11.079790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.081133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6305f1-657a-4570-ad29-2bd37b382f09 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.089264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 448/892] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:58:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:11.090474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721c656-93a8-49f4-b96d-1b14f6d0c214 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.090758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721c656-93a8-49f4-b96d-1b14f6d0c214 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.091030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721c656-93a8-49f4-b96d-1b14f6d0c214 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.092240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 449/893] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:11.092908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721c656-93a8-49f4-b96d-1b14f6d0c214 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.128911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.137539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db25baa-e635-40d6-b900-6562c115f08a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.171995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.172645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.172930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.173207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.173995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] RBAC: Adding query filter params (interface=public, service_id=3aca43defa9f487aaa2b21b8443ec425, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:11.174341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.175702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.180646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 445/894] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/endpoints?service_id=3aca43defa9f487aaa2b21b8443ec425&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:11.181503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.193187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721c656-93a8-49f4-b96d-1b14f6d0c214 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.209677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.227281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d855-ee06-436f-9489-acf308ee888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.227941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d855-ee06-436f-9489-acf308ee888b None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.228227 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d855-ee06-436f-9489-acf308ee888b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.228504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d855-ee06-436f-9489-acf308ee888b None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.229224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d855-ee06-436f-9489-acf308ee888b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.230594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d855-ee06-436f-9489-acf308ee888b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.243418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 450/895] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:11 2022] POST /identity/v3/services => generated 241 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:11.244586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.244875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.245161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.271837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:11.273064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:11.291683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769547a7-f5df-42b8-8e09-cbefae18fc87 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.339306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.340916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.341439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.341950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.347947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 451/896] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:11.348812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.360294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.362084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.385354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:11.389650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:11.391361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:11.392333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:11.392333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:11.392333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:11.392333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:11.392333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 446/897] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:11.394995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.473867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f08b9d-e2b0-467d-b748-6e06e5c9e7b8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.479146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.504517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2df77-63df-4767-b98a-cb35ceaafe76 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.508895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.509554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.509835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.510113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.510827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.512167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.526252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 452/898] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:58:11.526252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.553018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.553936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.554346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.554699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.555570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.557237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:11.571455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:11.572700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:11.573754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 447/899] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:11.582273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.637321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.648327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bb883-3db0-4f3c-9d42-a1ca7652cec0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.686458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.687197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.688058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.688340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.689078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:11.689393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.690793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.703383 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68bf1e-ccde-49f6-ad84-761d148ecee9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.703710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 453/900] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:11.710789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.753409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.754413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.754734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.755920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.756654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:11.756973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.758373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.765643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 448/901] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:11.771276 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.798612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.826133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88d3ef-c3e2-4d52-82ee-17bbf4f80269 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.863536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.864485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.864867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.865258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.873494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.875653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:11.891588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:11.892968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:11.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 454/902] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:11.900822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:11.908986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbcc3-0e95-4bea-9f50-e04a5f1d3d7f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:11.919321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:11.944482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:11.945492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:11.945995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:11.946509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:11.947411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:11.947934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:11.949487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:11.955749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 449/903] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:11.961306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:12.042463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf9c32-04f7-49df-a317-7cf629cd5a7c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.057111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:12.088418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.089425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.089905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.090438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.091469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:12.091973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:12.093619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:12.102675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130a70f-7660-477e-ba6c-b92c02a230aa None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.112349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 455/904] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:12.117705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:12.144936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.145515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.145798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.146077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.146894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] RBAC: Adding query filter params (interface=public, service_id=c3efd70cd8e24296bd50c10a2c84412b, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:12.147208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:12.148563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:12.154264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 450/905] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:58:11 2022] GET /identity/v3/endpoints?service_id=c3efd70cd8e24296bd50c10a2c84412b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:12.159105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:12.202527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:12.248025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c26f3-6ddf-4933-aefd-340f5b2d50ca None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.285635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b58d9-0b27-47f9-9d86-76b7df43bc4f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.287190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.288102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.288582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.289107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.325075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:12.332842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.333513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.333799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.334076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.334791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:12.336732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:12.350426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 451/906] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:58:12 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:58:12.372199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:12.373691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:12.451639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:12.490619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 456/907] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:12 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:58:12.496173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:12.605694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac093fd-fac9-4c1b-924a-a4da5d3c29e5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.641426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.642570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.643055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.643527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.654257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:12.655940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:12.673587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:12.674529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:12.675416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:12.675416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:12.675416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:12.675416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:12.677608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 452/908] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:12.682796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:12.791091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6153d1c-17c8-4c82-84e3-c34946f90645 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.827080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.827750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.828064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.828343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.829068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:12.829374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:12.830765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:12.842751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 457/909] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:12.848792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:12.900471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:12.955768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3355f8-e149-4c20-bc61-60adaf8cd2ba None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:12.991604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:12.992397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:12.992678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:12.992951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:12.999927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.001371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:13.015924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:13.016832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:13.017721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 453/910] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:13.023121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.053895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:13.129049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94877a5-622b-43ed-a7bd-ef32fe613dd6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.163331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:13.164003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.164289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.164567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.165362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:13.165667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.167124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae53b4b-0a12-43cd-9ff1-8818c075bfaa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.180225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 458/911] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:13.186429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.292949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045772-cf3d-45e8-93ef-1142ded0cb21 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.303109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:13.329462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:13.330044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.330352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.330633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.331467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] RBAC: Adding query filter params (role.id=7c08ee310d8049c89a443db22d98cc2a, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=6948dca9b9bf40ed8e2195c463a49d84) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:13.331779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.333209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e212a3-d290-44aa-8f7f-77d4e1b3dbc7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.339192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 454/912] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/role_assignments?user.id=6948dca9b9bf40ed8e2195c463a49d84&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=7c08ee310d8049c89a443db22d98cc2a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:13.348255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea126a-b880-4b53-90e7-4144745950d7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.348572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea126a-b880-4b53-90e7-4144745950d7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.348876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea126a-b880-4b53-90e7-4144745950d7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.350660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 459/913] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:13.356540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.357053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.357137 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.375967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:13.377199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:13.453645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 455/914] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:13.476444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea126a-b880-4b53-90e7-4144745950d7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.573618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:13.587300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea126a-b880-4b53-90e7-4144745950d7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.622834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:13.623674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.623964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.624237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.624937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.626313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f733cd99-7b1d-4e45-95b0-e56c123fa11a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:13.638772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:13.639756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:13.641062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 460/915] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:13.646213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.711095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2495105-b45c-4cd4-a82e-fd7de823e408 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.711421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2495105-b45c-4cd4-a82e-fd7de823e408 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.711646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2495105-b45c-4cd4-a82e-fd7de823e408 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.713275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 461/916] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:13.718098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.718419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.719255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.738849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:13.739931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:13.767281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff6e72-b6fd-4083-a91a-90c3fff6edf6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.769208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:13.807003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:13.808112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.808624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.809132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.810285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:13.810895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.818246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 462/917] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:13.818389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.822862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 456/918] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:13.829029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.837879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.915412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:13.936829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6a0c3-56b9-4d8b-855d-d3c2f44885db None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.964210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b49500-d757-40de-9b80-ad74bec6c294 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.973407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:13.974413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.974902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.975379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.976304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:13.976830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.978420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.983885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 463/919] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:13.989918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.010410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.011511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.011799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.012078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.012735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.021387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:14.040523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:14.041495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:14.042365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 457/920] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:14.048591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.094620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.118435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b520-43fc-4ef7-9a88-87a857c57647 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.159969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.161162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.162090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.162541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.163754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] RBAC: Adding query filter params (interface=public, service_id=410bf376b6f0416a9d320dfb2e07824c, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:14.164462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.166393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.178359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 464/921] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/endpoints?service_id=410bf376b6f0416a9d320dfb2e07824c&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:14.183484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.184714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad3ec6-d09f-4554-8e20-184525833b80 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.196432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.234908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.236118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.236566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.237195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.238463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:14.238937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.240464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.253089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 458/922] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:14.255020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.297819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125d69-6c90-48e5-a7af-9a67fbeb8419 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.335115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.335918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.336503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.336614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.337435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.338821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.354685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 465/923] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:58:14 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:58:14.378590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.387505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfe24a-1f71-4252-ae41-50db7927e7cb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.427900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.428932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.429492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.429962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.430902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:14.431396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.432980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8e608-a402-4ca8-873f-e55178a6373b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.443842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 459/924] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:14.445521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.495638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2c83-4176-4dc9-b7a8-4503e3b019f5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.495975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2c83-4176-4dc9-b7a8-4503e3b019f5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.497251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2c83-4176-4dc9-b7a8-4503e3b019f5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.498719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 460/925] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:14.506397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.506885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.507252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.527999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:14.529801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:14.551936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.583817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db92a02-90f9-40bf-a6b3-cbffbe96196a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.621232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 461/926] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:14.631970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.632638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.632924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.633204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.634103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.635430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.643840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.661013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 466/927] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:14.752337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.765723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802e3d-8656-46d5-b4c5-7334cdd9e643 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.809292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.810094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.810406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.810680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.811331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.813362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:14.825745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:14.826845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:14.828175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 462/928] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:14.833759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:14.945625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbe9c-ecd8-4b33-8f99-6e1971a3bf45 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:14.975283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.981734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:14.982719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:14.983238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:14.983718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:14.985164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:14.985690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:14.987316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:14.993552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 467/929] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:14.998695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:15.103827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfccb31-07dd-4a07-981d-ae7e5d5f3a4a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:15.139008 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:15.139672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:15.139962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:15.140236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:15.141514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:15.141823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:15.143267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85055c3d-7ec7-4d56-ae1f-96c7f7944e36 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:15.148771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 463/930] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jun 24 08:58:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:15.154443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:15.259685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2bc43-f48a-475b-83f9-8032c40c2649 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:15.295112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba985d27-5ef7-4254-a1cf-663e8afdd8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:15.296136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985d27-5ef7-4254-a1cf-663e8afdd8a0 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:15.296677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985d27-5ef7-4254-a1cf-663e8afdd8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:15.297649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba985d27-5ef7-4254-a1cf-663e8afdd8a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:15.298637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba985d27-5ef7-4254-a1cf-663e8afdd8a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:15.300194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba985d27-5ef7-4254-a1cf-663e8afdd8a0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:15.322494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 468/931] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:15.450269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca1de-6791-4681-829e-b80383c336b7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:15.450269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca1de-6791-4681-829e-b80383c336b7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:15.450842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca1de-6791-4681-829e-b80383c336b7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:15.451826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 464/932] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:15.458189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:15.458819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:15.459322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:15.479390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:15.479598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:15.531712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:15.560203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 469/933] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:15.583611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca1de-6791-4681-829e-b80383c336b7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:15.599338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:15.692041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca1de-6791-4681-829e-b80383c336b7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:15.726935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:15.727748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:15.728028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:15.728302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:15.739485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:15.747913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:15.748842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:15.749726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 465/934] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 08:58:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:15.759311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:15.862312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307983-956a-4e7c-9703-b269b6cd0326 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:15.900098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:15.900770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:15.901051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:15.901322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:15.902078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:15.902416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:15.903782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:15.913086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 470/935] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:58:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:15.918685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:15.988330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:16.024275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19b942-e822-49c1-aa3f-e4cbbdf87d9d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.063606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.064397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.064678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.064955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.075200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.076632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:16.094579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:16.095486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:16.096460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:16.096460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:16.096460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:16.096460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:16.096460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 466/936] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:16.103420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.144613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:16.205544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ccb9d-4062-41b5-a147-472951c355ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.239420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.240080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.240360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.240636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.241612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:16.241920 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.243301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.256307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 471/937] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:16.261979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.376213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b32-07ee-43ce-8f88-817c3e5e090f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.399822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:16.410953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.411774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.412063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.412342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.420083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.422477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9f20519d-8648-4d55-965e-161cd5e123ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:16.437364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:16.438359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:16.439314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 467/938] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:16.444640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.507468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6a04-67c8-421a-b862-9e3d00466a8a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.507977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6a04-67c8-421a-b862-9e3d00466a8a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.508088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b6a04-67c8-421a-b862-9e3d00466a8a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.509493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 468/939] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:16.514526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.515176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.516225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.534021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:16.535654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:16.549484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:16.553442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45faed1-7dd7-4928-aede-3eba759ca158 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.590366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.591895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.592331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.592756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.594354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:16.594824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.596696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.616114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 469/940] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:16.619313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 472/941] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:16.624921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.640673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.731766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88552cc0-c76e-40eb-ac46-09fbf79e2608 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.745737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50811d56-99ac-4a53-8a12-b53570d13e42 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.748408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:16.770970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.772061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.772499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.772986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.784200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.785901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.787266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.788177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.788463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.788739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.789492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.790858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:16.803039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:16.804190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:16.805107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 473/942] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:16.806686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:16.807555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:16.808441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:16.808441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:16.808441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:16.808441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:16.808441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 470/943] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:16.813989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.817803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.835896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:16.923572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f379f-9059-474c-88c9-d7e50ee245ee None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.928689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fbd62-d390-4b07-b624-d999d6686746 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:16.957984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.958672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.958956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.959232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.959934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:16.960241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.961588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e02ef-2402-438f-bf21-30eea297a8f7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.965345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:16.965998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.971293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 474/944] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:16.971436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.971436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.971436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:16.971689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fee3f9-5436-44b7-a48a-4350d01b9dde None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.971772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:16.971852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fee3f9-5436-44b7-a48a-4350d01b9dde None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.971852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fee3f9-5436-44b7-a48a-4350d01b9dde None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:16.972009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714791-2365-422a-ade9-905e7a7d8c69 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:16.973331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 475/945] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:16.973966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fee3f9-5436-44b7-a48a-4350d01b9dde None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:16.988448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 471/946] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:16.988448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:16.988448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:16.988448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.004583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:17.005760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:17.029114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.073290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.090244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 472/947] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:17.090244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.099457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fee3f9-5436-44b7-a48a-4350d01b9dde None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.135775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.136437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.136723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.136998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.137706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:17.138011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.139425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.145154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 476/948] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:17.145934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.188610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4791b1-96ba-4046-bcb4-7a5c0664bbf1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.224153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.224939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.225220 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.225499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.232163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.233593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:17.247321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:17.248218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:17.249121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 473/949] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:17.250120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.252768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029f5b9-c9d5-4700-9880-81552cc02a3a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.273437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.291965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.292761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.293038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.293309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.293957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.295393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:17.307183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:17.308200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:17.314769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 477/950] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:17.315669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.327899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.364012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d9627-e79f-473d-898c-6637fd1a959b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.397693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.398373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.398659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.398937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.399673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.401032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.423456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f822a7a-b59a-4118-bf87-d53192a46ed7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.438251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 474/951] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:17.438251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.468656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.469424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.469786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.470158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.471133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:17.471516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.473031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.486918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 478/952] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:17.493639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.530925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.569852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9423ce-44e8-4df7-9770-083a5c27815d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.589964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.615498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.616167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.617332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.617332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.617669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:17.617971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.619380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbccde-80c4-42e5-bf37-0bfe84f8ad64 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.625193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 475/953] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:17.625934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03df0-46d0-4517-b302-8b681e49f471 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.626889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717237d1-bfe4-4e67-85f9-ae612e06a112 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.627277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717237d1-bfe4-4e67-85f9-ae612e06a112 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.627571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717237d1-bfe4-4e67-85f9-ae612e06a112 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.628819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 476/954] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:17.630984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717237d1-bfe4-4e67-85f9-ae612e06a112 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.666995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602d414-0e8c-4b2b-869b-d845751e5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.668020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602d414-0e8c-4b2b-869b-d845751e5251 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.668372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602d414-0e8c-4b2b-869b-d845751e5251 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.668816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602d414-0e8c-4b2b-869b-d845751e5251 None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/6948dca9b9bf40ed8e2195c463a49d84/roles/7c08ee310d8049c89a443db22d98cc2a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.671041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602d414-0e8c-4b2b-869b-d845751e5251 None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=6948dca9b9bf40ed8e2195c463a49d84, role_id=7c08ee310d8049c89a443db22d98cc2a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.672965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602d414-0e8c-4b2b-869b-d845751e5251 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.686369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 479/955] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:58:17 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/6948dca9b9bf40ed8e2195c463a49d84/roles/7c08ee310d8049c89a443db22d98cc2a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:58:17.688150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.688434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.688731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.711495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:17.714422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:17.770628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717237d1-bfe4-4e67-85f9-ae612e06a112 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.806124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 480/956] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:17.808442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.809210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.809557 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.809901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.818010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:17.818010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:17.818010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:17.818796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.823001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 477/957] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:17.830171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:17.911060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:17.960514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580db0c-f4d1-4797-bd53-848343c6aa26 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:17.997046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:17.997720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:17.998006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:17.998316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:17.999036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:18.000503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:18.001882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING keystone.server.flask.common [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 08:58:18.025188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.sql.core [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 08:58:18.025188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 08:58:18.025188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [parameters: {'id': '917e3cf2270f4603966517437bf06a98', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 08:58:18.025188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80253) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 917e3cf2270f4603966517437bf06a98.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 917e3cf2270f4603966517437bf06a98. Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:58:18.034038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 08:58:18.034905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application yield resource Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise self.value Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application session.commit() Jun 24 08:58:18.035925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:58:18.036967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:58:18.037904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:58:18.042211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [parameters: {'id': '917e3cf2270f4603966517437bf06a98', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:18.043328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:18.044206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 917e3cf2270f4603966517437bf06a98. Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:18.045409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 481/958] 10.222.0.16 () {60 vars in 1140 bytes} [Fri Jun 24 08:58:17 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:18.047128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:18.152546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef34a9-8567-4f4b-ba6b-a92185ed8288 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:18.187990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:18.189206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:18.189723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:18.190194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:18.197651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:18.199431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8d504a4e-61fe-499a-b3b9-cdcd2bb1c424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:18.214539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:18.215497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:18.216463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:18.219517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 478/959] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:18.225241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:18.330353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff634fc-e2ab-469b-982f-fd1f388005a9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:18.351326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:18.375068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:18.376084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:18.376578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:18.377064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:18.378040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:18.378560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:18.380368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d19561-a07c-46db-a1ba-825a3fc780bc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:18.401349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 482/960] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:19.528061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb16e83-47e4-4ad1-a7f3-d5a891eb91ba None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.528605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb16e83-47e4-4ad1-a7f3-d5a891eb91ba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.528605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb16e83-47e4-4ad1-a7f3-d5a891eb91ba None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.530265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 479/961] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:19.536236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.536677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.536848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.554651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:19.556485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:19.630112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 483/962] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:19.654034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb16e83-47e4-4ad1-a7f3-d5a891eb91ba None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:19.721019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:19.761517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb16e83-47e4-4ad1-a7f3-d5a891eb91ba None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:19.797536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:19.798282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.798573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.798850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.799502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:19.800867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b21ddf8c-20b7-4bae-bbf7-86701904d010 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:19.813057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:19.814162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:19.815690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 480/963] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:19.820520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:19.822140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd79a-9082-4231-a9c6-1c8cdbda9b13 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.822676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd79a-9082-4231-a9c6-1c8cdbda9b13 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.823180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd79a-9082-4231-a9c6-1c8cdbda9b13 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.825007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 481/964] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:19.830171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.830722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.831233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.849423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:19.851173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:19.929065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 482/965] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:19.938585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74ea8-1aad-4eb5-8026-bc5c562e9a70 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:19.940959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:19.953660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:19.976184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:19.976951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.977233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.977503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.978204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:19.978542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:19.980118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab487e-11ad-46a0-be83-496c87142792 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:19.989826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 484/966] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:19.989826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49539-e6c2-49ec-a014-eac5d580cb60 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:19.989826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49539-e6c2-49ec-a014-eac5d580cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:19.989826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49539-e6c2-49ec-a014-eac5d580cb60 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:19.989826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 485/967] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:19.993470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49539-e6c2-49ec-a014-eac5d580cb60 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.018467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.063472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43241-00ee-46e3-8144-227806777c1a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.099528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e70f9-c62c-480c-973d-3dbdf94743d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.100339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e70f9-c62c-480c-973d-3dbdf94743d2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.100653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e70f9-c62c-480c-973d-3dbdf94743d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.101040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e70f9-c62c-480c-973d-3dbdf94743d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.105273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49539-e6c2-49ec-a014-eac5d580cb60 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.111646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e70f9-c62c-480c-973d-3dbdf94743d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-bf8e70f9-c62c-480c-973d-3dbdf94743d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:20.120825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:20.122003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:20.122907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 483/968] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 08:58:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:20.123636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.123636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.124175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.140721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:20.141882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:20.145897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.146597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.146884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.147161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.147868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:20.148178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.149530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.159847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 486/969] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:20.159847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.192571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.216418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 484/970] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:20.217262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.272542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.282765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6246a7-e2f1-4da7-83e0-57aaf0adc962 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.319928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.320899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.321509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.322078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.322995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:20.323464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.325172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.327704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071e14-3662-4d59-93f5-94b6bf6de945 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.334512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 487/971] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:58:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:20.335658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.366769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.367540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.367831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.368108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.368920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] RBAC: Adding query filter params (interface=admin, service_id=410bf376b6f0416a9d320dfb2e07824c, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:20.369242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.370640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.376736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 485/972] 10.222.0.16 () {56 vars in 1249 bytes} [Fri Jun 24 08:58:20 2022] GET /identity/v3/endpoints?service_id=410bf376b6f0416a9d320dfb2e07824c&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:20.377518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.437568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.444977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326afe8b-243d-4b20-ac3a-7e7083d5358e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.481816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4b866-9d3a-4a10-b54a-898a5a1e1058 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.482276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.482944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.483377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.483664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.485204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.486582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.491897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.503398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 488/973] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:20 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:20.504477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.543373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.544219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.544505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.544803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.556210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.557686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-84c2e9cf-e308-427f-b555-3b70d9802de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:20.578727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:20.579709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:20.580710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:20.580710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:20.580710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:20.580710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:20.582493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 486/974] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:20.584118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44eba-c5e8-471e-b8d3-5dfe9a01283d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.584475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44eba-c5e8-471e-b8d3-5dfe9a01283d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.585015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44eba-c5e8-471e-b8d3-5dfe9a01283d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.586662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 487/975] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:20.588080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d44eba-c5e8-471e-b8d3-5dfe9a01283d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.625909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000964a3-d82e-4764-900a-65da57e942e5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.668822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc282b7-a6f5-4149-bd26-b2da093dcdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.669491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc282b7-a6f5-4149-bd26-b2da093dcdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.669780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc282b7-a6f5-4149-bd26-b2da093dcdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.670067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc282b7-a6f5-4149-bd26-b2da093dcdf7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.670767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc282b7-a6f5-4149-bd26-b2da093dcdf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.672160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc282b7-a6f5-4149-bd26-b2da093dcdf7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.678748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 489/976] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:58:20 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:58:20.679950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.680236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.680513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.698875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:20.701034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:20.713773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d44eba-c5e8-471e-b8d3-5dfe9a01283d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.717469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.768412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.769082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.769553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.769875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.770685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:20.771109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.772529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.785484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 490/977] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:20.786095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 488/978] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:20.791608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.815709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:20.836169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.911947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009a6ab-0cbb-4b18-be07-7939e919a633 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.938365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28707d3d-6aad-452d-8290-ead06cb44608 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:20.954511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.956087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.956597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.957082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.967364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.969856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.972620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:20.973507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:20.973695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:20.973941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:20.974740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:20.976144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:20.977452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING keystone.server.flask.common [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:20.989454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:20.990534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:58:20.991786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:20.992366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.sql.core [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:58:20.992366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 08:58:20.992366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [parameters: {'user_id': '27adcd0fb2b541f9a65191f57fc115be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 08:58:20.992366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80254) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:58:20.994770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 491/979] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:58:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:21.003536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() Jun 24 08:58:21.013072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:58:21.014012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application yield resource Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise self.value Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application session.commit() Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:58:21.015898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:58:21.016824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:58:21.017715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application result.read() Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:58:21.018607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [parameters: {'user_id': '27adcd0fb2b541f9a65191f57fc115be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:21.019485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 08:58:21.020299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 08:58:21.021231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 08:58:21.021231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 08:58:21.021231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:58:21.021231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:58:21.021231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 08:58:21.021231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.021579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:21.024917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 489/980] 10.222.0.16 () {60 vars in 1131 bytes} [Fri Jun 24 08:58:20 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:21.032860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.128907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:21.139720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d4575-e83f-4c2e-985a-3b6a6896f8f4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:21.153637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccdad8e-3013-4b26-9fb4-bc0e14c31073 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:21.178577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:21.179604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:21.180078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:21.180540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:21.181792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:21.182306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:21.184019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:21.189848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:21.190676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:21.190955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:21.191226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:21.199717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:21.201428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:21.206639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 492/981] 10.222.0.16 () {56 vars in 1149 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:21.212755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:21.222364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:21.223334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.224274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 490/982] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:21.231151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.287176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:21.325593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a9c60-6058-4197-a643-02949cc9e700 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:21.335718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52947d-4dac-47c2-a12c-f38a955cbc57 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:21.362395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:21.362944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:21.363232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:21.363512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:21.371363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:21.372302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:21.372802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:21.373287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:21.374375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:21.375408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:21.377018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:21.394671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:21.422617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 491/983] 10.222.0.16 () {56 vars in 1101 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:21.441485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:21.443025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:21.517788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:21.558374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 493/984] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:21.564209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.672255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cad71c-93cd-4486-a997-faf7241e7073 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:21.709453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:21.710274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:21.710566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:21.710846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:21.721680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:21.723164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:21.741756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:21.743243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:21.744147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:21.744147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:21.744147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:21.744147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:21.744147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 492/985] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:21.750101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.849242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553be2f-27b8-4f05-aa81-95d38007d6ab None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:21.884940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:21.885612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:21.885900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:21.886182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:21.886941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:21.887252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:21.888612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:21.904939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 494/986] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:21.906722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:21.956591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:22.007667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceceb1-90ee-4354-98fc-f20c4760e997 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:22.047452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:22.048237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.048516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.048788 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.055389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:22.056811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:22.070279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:22.071139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:22.072046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:22.074287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 493/987] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:22.077110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:22.106277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:22.180486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840636c-1820-4faf-9c58-34865dee3758 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:22.214245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:22.214840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.215128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.215410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.216210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:22.216525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:22.217948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c1766-1e14-469c-b595-91460e1ca4df None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:22.231118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 495/988] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:22.237344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:22.340534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1de4dd-ec5d-411e-abaf-64652c6cce14 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:22.349640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:22.384351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:22.385105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.385459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.385837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.386781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] RBAC: Adding query filter params (role.id=7c08ee310d8049c89a443db22d98cc2a, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=6948dca9b9bf40ed8e2195c463a49d84) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:22.387166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:22.388657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16089-b795-445f-8f09-2df70d9264ba None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:22.394863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 494/989] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:22 2022] GET /identity/v3/role_assignments?user.id=6948dca9b9bf40ed8e2195c463a49d84&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=7c08ee310d8049c89a443db22d98cc2a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:22.671111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1c12-c056-4cf9-bf3c-f4a55eebb022 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.671466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1c12-c056-4cf9-bf3c-f4a55eebb022 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.671714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1c12-c056-4cf9-bf3c-f4a55eebb022 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.673236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 496/990] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:22.678392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fd4dd-b39e-493e-ad9e-6cb4bf4d154b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.678848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fd4dd-b39e-493e-ad9e-6cb4bf4d154b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.678944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fd4dd-b39e-493e-ad9e-6cb4bf4d154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.696353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bc5fd4dd-b39e-493e-ad9e-6cb4bf4d154b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:22.697872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bc5fd4dd-b39e-493e-ad9e-6cb4bf4d154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:22.768685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 495/991] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:22.791617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1c12-c056-4cf9-bf3c-f4a55eebb022 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:22.831216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca759-0350-4e25-a99b-87c77993d742 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.831523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca759-0350-4e25-a99b-87c77993d742 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.831790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ca759-0350-4e25-a99b-87c77993d742 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.833345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 496/992] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:22.838500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.838998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.839477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.856369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:22.857554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:22.886591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:22.904965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1c12-c056-4cf9-bf3c-f4a55eebb022 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:22.931345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 497/993] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:22.943741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:22.944541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:22.944828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:22.945105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:22.945766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:22.947177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:22.958250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:22.959488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:22.960507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:22.961499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 497/994] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:22.966420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:22.994116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:23.076757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b942ad-ddce-4362-94d2-407c1a02b0e5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.078345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fe4c6-c793-4fd6-9005-7887686611ec None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.113600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.114294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.114608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.114851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.115556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:23.115861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.117077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.117477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.118057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.118458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.118805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.119532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.120958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.122832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 498/995] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:23.128362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:23.133835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:23.135095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:58:23.136135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:23.142184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 498/996] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jun 24 08:58:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:23.142869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:23.147782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:23.241725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:23.243170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0afa648-328a-426b-8b8d-38faf26401bf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.248698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55f7ee-b5a8-44c9-ab38-e34b056c19e1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.282033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.282803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.283151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.283490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.283631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.284272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.284384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:23.284563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.284760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.284859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.285533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:23.285840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.286359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.287215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.296386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 499/997] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:23.296528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 499/998] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:23.297806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:23.297917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:23.381023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:23.404143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f7cb3-58de-4dca-be4d-6642d4c3b47b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.406595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be768868-6fbb-4a6f-8b76-66cb759a236a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.438288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.439079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.439543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.439896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.440827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] RBAC: Adding query filter params (interface=public, service_id=3a5008170542497a97356e2cacbed9c5, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:23.441261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.442030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.442719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.442923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.443025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.443273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.443982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:23.444295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.445953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.448750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 500/999] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:58:23 2022] GET /identity/v3/endpoints?service_id=3a5008170542497a97356e2cacbed9c5&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:23.455963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 500/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jun 24 08:58:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:23.456105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:23.457476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:23.485223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:23.557795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd54c7-4fc6-4183-8efa-9263172f5467 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.569622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591fac8-8234-4594-ba58-0b34cd0749a9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:23.592497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bc343-212d-4453-8bee-736bbbeaa5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.593162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc343-212d-4453-8bee-736bbbeaa5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.593977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc343-212d-4453-8bee-736bbbeaa5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.594280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bc343-212d-4453-8bee-736bbbeaa5f7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.594982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bc343-212d-4453-8bee-736bbbeaa5f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.596330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bc343-212d-4453-8bee-736bbbeaa5f7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.603612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 501/1001] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:58:23 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:58:23.605014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a256e7-ee33-462f-81bb-0ea6e091c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:23.605797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a256e7-ee33-462f-81bb-0ea6e091c795 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:23.606194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a256e7-ee33-462f-81bb-0ea6e091c795 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:23.606593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a256e7-ee33-462f-81bb-0ea6e091c795 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:23.607444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a256e7-ee33-462f-81bb-0ea6e091c795 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:23.609494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a256e7-ee33-462f-81bb-0ea6e091c795 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:23.629820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 501/1002] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:58:24.467357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfce699-09d9-45e8-95f7-81d2f2e4da4b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:24.467897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfce699-09d9-45e8-95f7-81d2f2e4da4b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:24.467986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfce699-09d9-45e8-95f7-81d2f2e4da4b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:24.469486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 502/1003] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:24.474426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:24.474810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:24.474998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:24.492199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:24.493387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:24.573751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 502/1004] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:24 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:24.595820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfce699-09d9-45e8-95f7-81d2f2e4da4b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:24.605449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:24.701753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfce699-09d9-45e8-95f7-81d2f2e4da4b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:24.738705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:24.739483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:24.739754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:24.739972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] PATH_INFO: `/v3/services/image` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:24.740878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:24.742735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:24.755248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:24.756364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:24.757229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 503/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jun 24 08:58:24 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:24.762691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:24.775820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:24.865711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b5a2e-7f27-47f2-87ad-38bd2c300905 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:24.900070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:24.900734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:24.901025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:24.901307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:24.902014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] RBAC: Adding query filter params (name=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:24.902352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:24.903729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27823af-d33a-4a40-bbc9-d626c021c37d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:24.908747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 503/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:24.914157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:24.982663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:25.021492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c53a7-7385-454e-aa8d-f43880139a45 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:25.056664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:25.057342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.057631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.057911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.058650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:25.058964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:25.060324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f629a-5094-4622-a625-4806e9e63c51 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:25.065697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 504/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:25.655436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446261-5af0-4ad8-b200-94cdd6d3285e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.656453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446261-5af0-4ad8-b200-94cdd6d3285e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.656532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c446261-5af0-4ad8-b200-94cdd6d3285e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.657917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 504/1008] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:25.663035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.663415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.663594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.680900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:25.682066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:25.686636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8342a3-73b5-4b6d-905e-f9fe8d15422b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.686960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8342a3-73b5-4b6d-905e-f9fe8d15422b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.687239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8342a3-73b5-4b6d-905e-f9fe8d15422b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.688618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 505/1009] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:25.693550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.693846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.694127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.710738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:25.711916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:25.756322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 505/1010] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:25.779552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:25.783876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 506/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:25.807623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:25.811481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:25.847919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:25.888707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb54b7-4959-41dc-8e3d-6ded47d8214e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:25.914010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6710a-fda9-46a3-9752-a73202d78ef0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:25.925035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:25.926045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.926543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.926981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.927775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:25.929277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:25.942209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:25.943674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:58:25.944660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:25.946749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 506/1012] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:25.952531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:25.954901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:25.955699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:25.955968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:25.956243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:25.957411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:25.958868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:25.960616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 507/1013] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:25.965966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:26.047358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:26.072749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c4c0b-161c-4fff-8b72-3f46728c2a0b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:26.078847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ef5e-b8ba-4c6b-93d3-132d26c421f1 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:26.103263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:26.111690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:26.112360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:26.112655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:26.112919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:26.113631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:26.113942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:26.115324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:26.116158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:26.117230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:26.117516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:26.117781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:26.118544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:26.119944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:26.120987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 507/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:26.126646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:26.150761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 508/1015] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:25 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:58:26.248531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d741d-410c-4b09-bcb3-3650514846f1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:26.287784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:26.288468 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:26.288753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:26.289031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:26.289753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:26.290062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:26.291478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfd31a-e7a5-4074-a799-648354fa82ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:26.297700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 508/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Fri Jun 24 08:58:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:26.303989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:26.408982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9071b0-7010-430f-8c21-6423e49fb71a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:26.431849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:26.444568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c11ffe-eb6e-492e-917e-5395aa85474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:26.445228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11ffe-eb6e-492e-917e-5395aa85474e None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:26.445511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11ffe-eb6e-492e-917e-5395aa85474e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:26.445783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11ffe-eb6e-492e-917e-5395aa85474e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:26.446547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c11ffe-eb6e-492e-917e-5395aa85474e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:26.447895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c11ffe-eb6e-492e-917e-5395aa85474e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:26.467738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 509/1017] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:58:27.099037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2129-6f58-4164-9864-c1c49e322500 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:27.099576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2129-6f58-4164-9864-c1c49e322500 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:27.099576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2129-6f58-4164-9864-c1c49e322500 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:27.100953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 509/1018] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:27.106423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6991-dad5-49a8-b40c-23150e13bca3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:27.106816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6991-dad5-49a8-b40c-23150e13bca3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:27.106981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c6991-dad5-49a8-b40c-23150e13bca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:27.123697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ea2c6991-dad5-49a8-b40c-23150e13bca3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:27.125385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ea2c6991-dad5-49a8-b40c-23150e13bca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:27.200007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 510/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:27 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:27.223410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2129-6f58-4164-9864-c1c49e322500 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:27.280419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:27.328887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2129-6f58-4164-9864-c1c49e322500 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:27.363301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352705d-21d3-4c09-9802-97f481ef94a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:27.363965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352705d-21d3-4c09-9802-97f481ef94a7 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:27.364249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352705d-21d3-4c09-9802-97f481ef94a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:27.364527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352705d-21d3-4c09-9802-97f481ef94a7 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:27.365264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352705d-21d3-4c09-9802-97f481ef94a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:27.366922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352705d-21d3-4c09-9802-97f481ef94a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:27.380004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 510/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:27 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:28.246607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ea85-d368-4827-b4ab-d469beec57e1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.247144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ea85-d368-4827-b4ab-d469beec57e1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.247144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ea85-d368-4827-b4ab-d469beec57e1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.248528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 511/1021] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:28.254311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.254683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.254875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.272098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:28.273275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:28.346762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 511/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:28.371183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ea85-d368-4827-b4ab-d469beec57e1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:28.472652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ea85-d368-4827-b4ab-d469beec57e1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:28.480165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:28.510306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3fb85-2e6a-4822-a111-dee55b577d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:28.511100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3fb85-2e6a-4822-a111-dee55b577d12 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.511381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3fb85-2e6a-4822-a111-dee55b577d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.511655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3fb85-2e6a-4822-a111-dee55b577d12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.512835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3fb85-2e6a-4822-a111-dee55b577d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:28.514292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3fb85-2e6a-4822-a111-dee55b577d12 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:28.521035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 512/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:28.522557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:28.565865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:28.589451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af726e-daef-4e6b-9ccc-e6308d1f19d2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.589749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af726e-daef-4e6b-9ccc-e6308d1f19d2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.590004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af726e-daef-4e6b-9ccc-e6308d1f19d2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.591392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 513/1024] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:28.597567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.597791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.598076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.619458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:28.621231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:28.627625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ae197-18ff-4fde-91e2-a2f3541c2016 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:28.664207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:28.664876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.665158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.665433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.666160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:28.667591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:28.698250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 512/1025] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:58:28 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:28.711085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 514/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:28.734953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:28.842553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:28.847446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c818f-4a37-4c52-9c53-dc351ca700ae None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:28.885334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:28.886510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:28.886796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:28.887075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:28.898058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:28.906463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:28.907415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:28.908275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 513/1027] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 08:58:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:28.913755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.022052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddeed3-acf1-4272-aee4-b7f7a6ba8cb1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.024854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:29.059666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.060338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.060684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.060964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.061738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:29.062048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.063445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.076351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 515/1028] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:58:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:29.078493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.181733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a2b7a-5750-4f2d-b1ec-fe9c289996dd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.215452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.216231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.216513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.216784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.227933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.229358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:29.246743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:29.247663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:29.248591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:29.248591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:29.248591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:29.248591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:29.250600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 514/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:29.254373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.353090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889bd9-73e9-44a2-ae3f-e18c3031d307 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.386499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.387161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.387444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.387714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.388433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:29.388735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.390112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fcc58e-d764-48fb-aeaa-49a532a5db93 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.406972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 516/1030] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:29.408206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.421113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:29.443748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8031a-0d68-45a5-9cb4-9975d06d0b9e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.443947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8031a-0d68-45a5-9cb4-9975d06d0b9e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.444217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8031a-0d68-45a5-9cb4-9975d06d0b9e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.445592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 517/1031] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:29.450522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.450816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.451105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.471314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:29.473590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:29.500205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:29.517909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada2c86-060b-438d-8296-997005b3ba47 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.554757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 518/1032] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:29.558947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.559836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.560187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.560532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.568714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.570136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.578353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:29.585152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:29.586100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:29.587109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 515/1033] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:29.591973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.669130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:29.684528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9413f-9e2e-41e9-a2e5-f8fe0478ea00 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.705157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db1c20-68b2-4a31-9c39-2162840a2fd7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.718911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.719700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.719986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.720255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] PATH_INFO: `/v3/services/image` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.720906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.722286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:29.734647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:29.735641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:29.736520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 519/1034] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:29.741922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.744263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.745250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.745745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.746023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.746900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:29.747274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.748681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.764051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:29.770051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 516/1035] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:29.776360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.847641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32bb15-9094-4e5e-a001-2861884b360e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.884286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.884956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.885239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.885522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.886241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] RBAC: Adding query filter params (name=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:29.886554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:29.887661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cf3a-4aeb-4af0-bfbb-d20a9783896e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:29.887926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:29.893819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 520/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:29.899081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:29.922256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:29.931970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:29.932619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:29.932926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:29.933171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:29.990608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.005101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.006566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.008286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8a602-b985-427d-b1a8-fea765572695 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.046454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.047123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.047415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.047715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.048420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] RBAC: Adding query filter params (type=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:30.048729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.050097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.055020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 521/1037] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:30.060670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.129872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 517/1038] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:58:30.135462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.164014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.173103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c5d2-be14-4ef9-b74c-9bdcb7bd355c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.209575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.210275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.210550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.210830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.211628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] RBAC: Adding query filter params (interface=public, service_id=00c3a07aca874089aef09d97d5d11413, region_id=RegionOne) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:30.211943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.213308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.219147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 522/1039] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/endpoints?service_id=00c3a07aca874089aef09d97d5d11413&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:30.224386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.240857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a08d1-5e9c-4a0b-8ef7-d52afd6bd541 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.241018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.279827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.281474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.281968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.282347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.293038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.294645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:30.312759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:30.313712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:30.314698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:30.314698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:30.314698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:30.314698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:30.314698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 518/1040] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:30.319579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.332995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6478100-308b-4899-8cc3-ff2599d38837 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.372828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.373614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.373797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.374040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.374780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.376146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.382965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 523/1041] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:58:30.412771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.435269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793957d8-ffc4-4765-afe3-f03179cd26e6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.475252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.475933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.476219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.476495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.477304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:30.477618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.479034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.497083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 519/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:30.498955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.584475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.609055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f1951-4596-4716-81dc-7566f515b6fc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.643914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.644709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.644996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.645272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.652404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.653843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a51ea8d4-f2a2-4eb2-bc34-c64380e7177b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:30.668746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:30.669645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:30.670971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:30.672146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 524/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:30.676561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.779235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723e03-986d-4ed0-a58f-5bcc99c1fbc9 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.779535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723e03-986d-4ed0-a58f-5bcc99c1fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.779755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723e03-986d-4ed0-a58f-5bcc99c1fbc9 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.781696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 525/1044] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:30.786437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff24f2f-e5bc-49eb-8193-72aab53f7c3e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.786644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.786936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.787217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.803782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:30.804953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:30.824174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.825074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.825516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.825788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.826620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:30.826935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.828905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:30.838383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.841974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 520/1045] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:30.848369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.876359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 526/1046] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:30.900400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:30.956798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53589eb7-aef8-4f83-83f1-d9617e233c94 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:30.963769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:30.994369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:30.995022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:30.995507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:30.995616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:30.996420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] RBAC: Adding query filter params (role.id=7c08ee310d8049c89a443db22d98cc2a, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=572e1cbd83cb43c396cd474079633af7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:30.996692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:30.998101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:31.001738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f5a7-0fe8-4cdb-9bc2-b15f7d8fcf7f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:31.004618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 521/1047] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/role_assignments?user.id=572e1cbd83cb43c396cd474079633af7&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=7c08ee310d8049c89a443db22d98cc2a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:31.053520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:31.054375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:31.054659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:31.054932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:31.067574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:31.075441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:31.076548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:31.077509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 527/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:31.083391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:31.152273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:31.194462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c188a-29eb-466e-9c62-d6557b98eeb2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:31.228107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:31.228777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:31.229193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:31.229477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:31.230249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:31.230554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:31.231910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:31.244899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 522/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:31.246316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:31.347795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b6f88-f299-452e-a214-bc797edc8687 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:31.372634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:31.382416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:31.383306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:31.383571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:31.383844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] PATH_INFO: `/v3/users/8f46bc12f03e401e815b08d84e5ef164` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:31.397539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] RBAC: Authorizing `identity:get_user(user_id=8f46bc12f03e401e815b08d84e5ef164)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:31.399011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:31.402290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 528/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:31 2022] GET /identity/v3/users/8f46bc12f03e401e815b08d84e5ef164 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:31.407089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:31.515200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787fe79-1cfd-4b54-b22c-236269ca09fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:31.542389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:31.552279 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:31.552928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:31.553276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:31.553482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:31.621425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:31.622908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:31.721743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 523/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:31.726394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:31.824574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906110c-3ad1-4069-b008-271ab7d60b0a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:31.857792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba4bb0-d60b-47b0-8dce-34fe2aab0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:31.858730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba4bb0-d60b-47b0-8dce-34fe2aab0605 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:31.859013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba4bb0-d60b-47b0-8dce-34fe2aab0605 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:31.859285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba4bb0-d60b-47b0-8dce-34fe2aab0605 None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:31.860450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba4bb0-d60b-47b0-8dce-34fe2aab0605 None admin] RBAC: Authorizing `identity:get_project(project_id=7a6a9f0341e94ff39a5b49371f25f01b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:31.861872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba4bb0-d60b-47b0-8dce-34fe2aab0605 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:31.864658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 529/1052] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:31 2022] GET /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:31.869865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:31.897432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:31.969555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce5d27-3c46-441d-8486-09e858d18c7c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:32.004139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:32.005101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:32.005558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:32.006002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:32.007093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b, user.id=8f46bc12f03e401e815b08d84e5ef164) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:32.007581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:32.009180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f325f-6adb-437d-a296-4ca3ec3772c6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:32.022669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 524/1053] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:31 2022] GET /identity/v3/role_assignments?user.id=8f46bc12f03e401e815b08d84e5ef164&scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:32.436132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec479d7-3139-4510-a34f-9d6b1bf1c4da None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:32.436649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec479d7-3139-4510-a34f-9d6b1bf1c4da None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:32.436796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec479d7-3139-4510-a34f-9d6b1bf1c4da None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:32.438080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 530/1054] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:32.443293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:32.443584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:32.443869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:32.460572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:32.461744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:32.529762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 525/1055] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:32.553481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec479d7-3139-4510-a34f-9d6b1bf1c4da None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:32.608941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:32.659752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec479d7-3139-4510-a34f-9d6b1bf1c4da None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:32.697727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:32.698475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:32.698762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:32.699034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] PATH_INFO: `/v3/services/image` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:32.699685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:32.701048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:32.712775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:32.713780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:58:32.714667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:32.716160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 531/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Fri Jun 24 08:58:32 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:32.720020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:32.741971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:32.822395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304445-745b-4bd6-94cb-c3e70bd27e9a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:32.856163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:32.856824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:32.857111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:32.857386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:32.858085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:32.858426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:32.859804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869371ae-1ee1-4758-923b-965a824f9e0f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:32.869235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 526/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:32.870451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:32.969032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a0834-3356-443e-8dbd-8f4ad56e51ce None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:32.984744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.003592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.004301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.004587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.004863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.005568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] RBAC: Adding query filter params (type=image) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:33.005877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:33.007263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:33.021020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 532/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:33.021020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:33.021276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3259-6beb-4746-972f-6c201ef9eca1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.021276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3259-6beb-4746-972f-6c201ef9eca1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.021276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3259-6beb-4746-972f-6c201ef9eca1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.021276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 527/1059] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:33.026118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.026511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.026797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.044263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:33.045438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:33.118675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 528/1060] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:33.134944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7cd1-683e-4b56-8f8a-d18cc694f640 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:33.139217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:33.154477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.174072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.174754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.175124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.175321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.176041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:33.177399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:33.198392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 533/1061] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 08:58:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:33.257648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2d651-63f8-4e9b-a7a0-ed8f3ff4cdaf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:33.301815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.302675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.302976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.303235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.314753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:33.323090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:33.324162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:33.325041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:33.329721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 529/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 08:58:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:33.331075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:33.369794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.438188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b0b6a-d4ba-46ab-bdb7-0ad9c90f0f0c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:33.471451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.472131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.472413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.472688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.473439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:33.473744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:33.475144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:33.488118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 534/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:58:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:33.489310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:33.560202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.594145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0ecf-4667-4306-809c-731a64456014 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:33.628527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.629328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.629612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.629891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.641242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:33.642706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:33.659683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:33.660616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:33.661686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:33.661686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:33.661686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:33.661686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:33.661686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 530/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:33.666453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:33.764416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.769667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccdc51-bc95-450a-973d-47e8b9b82d0b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:33.803535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.804192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.804472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.804744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.805459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:33.805761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:33.807147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:33.819090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 535/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:33.824364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:33.933699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b27246-8d30-455a-b36e-543f4c5548b9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:33.957605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.971647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:33.972806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:33.973348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:33.973841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:33.982291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:33.983974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-175a57b1-ccc4-4663-924f-c12d53a524f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:33.998743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:34.000200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:34.001156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:34.003942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 531/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:58:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:34.020868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.048068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0748b-237d-4667-9e63-02948ac5f3a2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.048391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0748b-237d-4667-9e63-02948ac5f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.049026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0748b-237d-4667-9e63-02948ac5f3a2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.050336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 532/1067] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:34.055192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.055426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.055709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.075436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:34.076504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:34.143012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099879b-305c-4290-9970-d201a0813d3f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.153691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 533/1068] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:34.176993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.179475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.180467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.180835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.181206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.182185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:34.182606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.184161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.206467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 536/1069] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:34.213806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.235035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.316373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c067b-7203-4585-a218-dc2f879d1b54 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.331504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.334136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733b72-ae89-41f0-955d-55a794164215 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.356875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.358110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.359118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.359565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.372060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.372780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.372905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:34.373071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.373341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:34.382546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:34.383476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:34.389873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:34.390553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.390716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 534/1070] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:34.390791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.390859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:34.404956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:34.405971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:34.407382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:34.407382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:34.407382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:34.407382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:34.407382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 537/1071] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:34.411733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.481695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.501104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1bc2c-b320-4c78-9fcf-ca4486eb86bb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.517349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604ade8-fd85-4e26-972f-eb65ee0eeecf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.539215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.539931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.540164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.540442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.541265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:34.541502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.542884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.551833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 535/1072] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:34.556374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.556934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.557203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.557305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.557484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.558207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:34.558546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.559899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.576710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 538/1073] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:34.578329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.597442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.670097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120975-02f1-4242-8cad-6f4e3be85fa9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.682754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede5612-b762-4198-8829-a8da3375b2d7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.704647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.705521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.705807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.706083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] PATH_INFO: `/v3/users/8f46bc12f03e401e815b08d84e5ef164` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.707343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] RBAC: Authorizing `identity:get_user(user_id=8f46bc12f03e401e815b08d84e5ef164)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.708761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.709410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.710439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 536/1074] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/users/8f46bc12f03e401e815b08d84e5ef164 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:34.716056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.723568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.724366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.724649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.724919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.731669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.733140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:34.747980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:34.749060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:34.749977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 539/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:34.754700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.826581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5b0f-07b3-4cb0-a149-b1205b06c722 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.828861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.855834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cd089-119c-4abc-8ecc-2d7cbdce3b03 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:34.867013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.867885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.868167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.868442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.869718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] RBAC: Authorizing `identity:get_project(project_id=7a6a9f0341e94ff39a5b49371f25f01b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.871171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.878028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 537/1076] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:34.878986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.897042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:34.897704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:34.897989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:34.898412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:34.899313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:34.899622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:34.901034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:34.918710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 540/1077] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:34.919662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:34.971090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:34.992679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df773f0-a6e0-435b-a3e8-a1afb57000fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:35.029166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e66868-76ca-4055-bba8-2a52ea1dfcc9 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:35.035648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4dcc8-3b70-443c-9a88-8fb5273df038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:35.036649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dcc8-3b70-443c-9a88-8fb5273df038 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:35.036938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dcc8-3b70-443c-9a88-8fb5273df038 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:35.037218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4dcc8-3b70-443c-9a88-8fb5273df038 None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b/users/8f46bc12f03e401e815b08d84e5ef164/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:35.039335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4dcc8-3b70-443c-9a88-8fb5273df038 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a6a9f0341e94ff39a5b49371f25f01b, user_id=8f46bc12f03e401e815b08d84e5ef164, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:35.040882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4dcc8-3b70-443c-9a88-8fb5273df038 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:35.066259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 538/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:58:34 2022] PUT /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b/users/8f46bc12f03e401e815b08d84e5ef164/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:58:35.075822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc52e5f-22fe-4e33-91d0-049c70261643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:35.076840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc52e5f-22fe-4e33-91d0-049c70261643 None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:35.077205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc52e5f-22fe-4e33-91d0-049c70261643 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:35.078101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc52e5f-22fe-4e33-91d0-049c70261643 None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/572e1cbd83cb43c396cd474079633af7/roles/7c08ee310d8049c89a443db22d98cc2a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:35.080613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc52e5f-22fe-4e33-91d0-049c70261643 None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=572e1cbd83cb43c396cd474079633af7, role_id=7c08ee310d8049c89a443db22d98cc2a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:35.082176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc52e5f-22fe-4e33-91d0-049c70261643 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:35.098799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 541/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:58:34 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/572e1cbd83cb43c396cd474079633af7/roles/7c08ee310d8049c89a443db22d98cc2a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:58:35.268466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7d7d-dfc9-4306-82a8-4893584eae5e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:35.268808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7d7d-dfc9-4306-82a8-4893584eae5e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:35.268999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a7d7d-dfc9-4306-82a8-4893584eae5e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:35.270661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 539/1080] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:35.277172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:35.277471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:35.277760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:35.295456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:35.296659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:35.366283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 542/1081] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:35.388525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7d7d-dfc9-4306-82a8-4893584eae5e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:35.419951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:35.492699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a7d7d-dfc9-4306-82a8-4893584eae5e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:35.526340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:35.527099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:35.527387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:35.527667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:35.598707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:35.600162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:35.629683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:35.700175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 540/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:35.706350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:35.747811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:35.812779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a48c-fabf-40cd-b374-37a970e8765d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:35.846436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:35.847233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:35.847521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:35.847801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:35.857839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:35.859854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-68b361d0-4afc-4645-ad94-28d2e5b8e98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:35.878183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:35.879145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:35.880175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:35.880175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:35.880175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:35.880175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:35.882378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 543/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:35.885299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:35.985349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248eb31-e4f5-4120-a996-4a4d4df63170 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:36.013154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:36.024323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:36.027617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:36.027617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:36.027617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:36.027617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:36.027617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:36.027999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4710-85c7-45af-8f10-271eb333585c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:36.046317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 541/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:37.107819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24908e-e0a2-4ff5-b1b4-d3551f2e3ab0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.108371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24908e-e0a2-4ff5-b1b4-d3551f2e3ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.108371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24908e-e0a2-4ff5-b1b4-d3551f2e3ab0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.109735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 544/1085] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:37.115197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.115612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.115756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.133587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:37.134784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:37.168505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87dcf3-c11c-45ec-ae89-b6e9f7da62b2 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.168875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87dcf3-c11c-45ec-ae89-b6e9f7da62b2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.169215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87dcf3-c11c-45ec-ae89-b6e9f7da62b2 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.170685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 545/1086] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:58:37.175981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.176271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.176555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.193935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:37.195131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:37.200491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 542/1087] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:37.223674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.265361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 546/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:58:37.288479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.308483 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.320409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf469ca-fb80-447b-8f7b-269f9f20b8bc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.340304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.355243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.356034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.356318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.356613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.367417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:37.375024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:37.376124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:37.376995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 543/1089] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:37.382059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.389433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0352a7-53e8-4ec4-ab84-34a30f625442 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.423208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.424006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.424294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.424570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.434905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:37.443184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:37.444248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:37.445113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 547/1090] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:37.450049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.484628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d64b18c-716b-474f-8de2-3d7c59197394 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.517458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.518215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.518521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.518793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.519534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:37.519839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:37.521187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:37.528813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.529028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 544/1091] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:37.535317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.549930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115c77-c412-4f98-88b6-d9ea4f43cb7c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.577399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.583439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.584106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.584385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.584666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.585404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:37.585711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:37.587097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:37.595492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 548/1092] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:37.600743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.635154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac35b-1da5-455c-86ee-1cda339446aa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.667607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.668681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.668960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.669230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] PATH_INFO: `/v3/users/8f46bc12f03e401e815b08d84e5ef164` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.670447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] RBAC: Authorizing `identity:get_user(user_id=8f46bc12f03e401e815b08d84e5ef164)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:37.672478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:37.674094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 545/1093] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/users/8f46bc12f03e401e815b08d84e5ef164 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:37.679582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.696678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b808c-6aaf-4d53-b10e-58bf7c3edc3f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.729376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.730155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.730466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.730741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.741909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:37.743375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:37.745079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:37.760947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:37.762012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:37.763165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:37.763165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:37.763165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:37.763165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:37.763165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 549/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:37.767804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.782493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4b90-0802-4d34-bbed-0df761d8e6e9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.793064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.816988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.817564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.817848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.818125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.864334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34ea78-799b-4b5d-b902-39798ebec4a7 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:37.884608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:37.886208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:37.898952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:37.899599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:37.899883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:37.900157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:37.900874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:37.901180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:37.902566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:37.913919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 550/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:37.919422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:37.972204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:37.986177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 546/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:58:37.992261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.003406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:38.017108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f577c3-39e4-44dc-8f73-74eee640da78 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.052200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.053218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.053496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.053770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.060616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.062717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:58:38.076766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:38.077771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:38.078779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 551/1097] 10.222.0.16 () {56 vars in 1093 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:38.083701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.090165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9639b-fb8b-4411-9f49-1de1dd98926a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.123561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.125034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.125320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.125592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.126796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] RBAC: Authorizing `identity:get_project(project_id=7a6a9f0341e94ff39a5b49371f25f01b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.128214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.129910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 547/1098] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:37 2022] GET /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:38.135851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.179813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddd304-0351-4be9-b9ed-7998573408a4 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.193752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:38.212322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:38.213907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.214599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.214880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.215157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.215988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:38.216295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.217697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.234071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9a25a-5ba8-4530-bd89-c48046cd783f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.234948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 552/1099] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jun 24 08:58:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:38.240343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.268973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.269622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.269906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.270176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.271040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b, user.id=8f46bc12f03e401e815b08d84e5ef164) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:38.271348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.272748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.278432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 548/1100] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:38 2022] GET /identity/v3/role_assignments?user.id=8f46bc12f03e401e815b08d84e5ef164&scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:38.341056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7fde5-bed1-46cb-a6ee-b97cd9571592 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.376613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.377269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.377551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.377825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.420526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:38.448610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.450050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.547241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 553/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:58:38.552987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.652050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c5880-0ac2-4a45-a755-5034cc4fda2e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.684654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.685443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.685726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.686002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.696729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.698157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.699879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:58:38.715734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:38.716673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:38.717586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:58:38.717586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:58:38.717586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:58:38.717586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:38.717586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 549/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:58:38.722565 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.791715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:38.821484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bbef8-e809-404d-80a6-1f6ad76ffc3a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:38.855486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:38.856144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:38.856426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:38.856699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:38.857416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:38.857719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:38.859628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:38.870745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 554/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 08:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:38.876817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:38.972661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846deaf-bc69-4a2e-b1d7-e1acf771a629 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:39.006504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:39.007293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:39.007580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:39.007856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:39.014358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:39.015837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:58:39.031855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:39.032935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:58:39.033904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 550/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 08:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:39.038804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:39.136144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8bb8-e292-4a01-809b-b68a29a1aa24 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:39.164548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:39.169859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:39.170543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:39.170829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:39.171675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:39.172515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:39.172824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:39.174262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bfdee-72f8-4396-8685-66b00f2ed3f5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:39.185864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 555/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 08:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:39.191785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:39.247515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:39.291518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b9254-cc25-4151-91ac-bd9d437a1daa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:39.325451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:39.326098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:39.326454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:39.326732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:39.327599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] RBAC: Adding query filter params (role.id=7c08ee310d8049c89a443db22d98cc2a, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=572e1cbd83cb43c396cd474079633af7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:39.327912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:39.329319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832c53-567b-4baf-a3ea-6c1eb1c503bb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:39.335133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 551/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:39 2022] GET /identity/v3/role_assignments?user.id=572e1cbd83cb43c396cd474079633af7&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=7c08ee310d8049c89a443db22d98cc2a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:40.319720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1ca8-4079-49ed-8129-64dae701d4b1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:40.320208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1ca8-4079-49ed-8129-64dae701d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:40.320208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b1ca8-4079-49ed-8129-64dae701d4b1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:40.321535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 556/1107] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:40.326741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:40.327114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:40.327300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:40.343549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:40.344718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:40.408055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 552/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:40.432372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1ca8-4079-49ed-8129-64dae701d4b1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:40.529782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b1ca8-4079-49ed-8129-64dae701d4b1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:40.562582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5590d3-4f77-47f4-bf25-60dc82a0c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:40.563347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5590d3-4f77-47f4-bf25-60dc82a0c1fc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:40.563628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5590d3-4f77-47f4-bf25-60dc82a0c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:40.563899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5590d3-4f77-47f4-bf25-60dc82a0c1fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:40.565055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5590d3-4f77-47f4-bf25-60dc82a0c1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:40.566491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5590d3-4f77-47f4-bf25-60dc82a0c1fc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:40.568052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 557/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:40.573608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:40.620331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:40.669054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922fd05-3595-468f-8326-bb0c111a8a5d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:40.701269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98645e-748a-4fc0-a07d-50bd6a42f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:40.701929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98645e-748a-4fc0-a07d-50bd6a42f458 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:40.702871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98645e-748a-4fc0-a07d-50bd6a42f458 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:40.703153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98645e-748a-4fc0-a07d-50bd6a42f458 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:40.703855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98645e-748a-4fc0-a07d-50bd6a42f458 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:40.705252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98645e-748a-4fc0-a07d-50bd6a42f458 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:40.724477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 553/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:58:40 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:42.746167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637d421-2c8a-4b87-8e92-b33e69bc952e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:42.746717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637d421-2c8a-4b87-8e92-b33e69bc952e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:42.747021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637d421-2c8a-4b87-8e92-b33e69bc952e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:42.748571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 558/1111] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:42.754532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:42.754944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:42.755093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:42.771996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:42.773166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:42.837295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 554/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:42.860502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637d421-2c8a-4b87-8e92-b33e69bc952e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:42.920229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:42.960972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637d421-2c8a-4b87-8e92-b33e69bc952e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:42.994466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:42.995303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:42.995585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:42.995860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] PATH_INFO: `/v3/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:42.997397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] RBAC: Authorizing `identity:get_role(role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:42.998746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:43.000132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 559/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:42 2022] GET /identity/v3/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:43.005716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:43.039148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:43.102598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2ab42-a650-4638-b81e-9920a95cd557 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:43.135539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:43.136389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:43.136667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:43.136938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] PATH_INFO: `/v3/users/8446e00e705c48fb930816dbf90b66cf` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:43.149983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] RBAC: Authorizing `identity:get_user(user_id=8446e00e705c48fb930816dbf90b66cf)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:43.151429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:43.153062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 555/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:43 2022] GET /identity/v3/users/8446e00e705c48fb930816dbf90b66cf => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:43.158817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:43.254621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55acf94-f500-484e-8fc0-57305c85d67e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:43.279274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:43.287159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:43.287792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:43.288074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:43.288350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:43.352041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:43.353466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:43.447696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 560/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:43.453392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:43.541285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:43.550774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ae355-4319-4ae4-9d8d-13fbab84a93f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:43.583174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dd560-a037-45aa-ad14-85968baf1fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:43.584020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dd560-a037-45aa-ad14-85968baf1fbf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:43.584307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dd560-a037-45aa-ad14-85968baf1fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:43.584588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dd560-a037-45aa-ad14-85968baf1fbf None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:43.585774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dd560-a037-45aa-ad14-85968baf1fbf None admin] RBAC: Authorizing `identity:get_project(project_id=7a6a9f0341e94ff39a5b49371f25f01b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:43.587221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dd560-a037-45aa-ad14-85968baf1fbf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:43.588908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 556/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:43 2022] GET /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:43.595223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:43.622113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:43.690468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3c58e-530d-49e7-a879-0532bdd0651b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:43.722903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:43.723540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:43.723822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:43.724096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:43.724917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] RBAC: Adding query filter params (role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b, user.id=8446e00e705c48fb930816dbf90b66cf) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:43.725226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:43.726661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cce7b-43c7-4dc2-96d3-f0f8a4d1bdaf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:43.731900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 561/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:43 2022] GET /identity/v3/role_assignments?user.id=8446e00e705c48fb930816dbf90b66cf&scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:45.678035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972b54-17a8-408e-acb7-e249f3f6a8cf None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:45.678587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972b54-17a8-408e-acb7-e249f3f6a8cf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:45.678587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972b54-17a8-408e-acb7-e249f3f6a8cf None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:45.679987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 557/1118] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:45.685045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:45.685458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:45.685598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:45.702414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:45.703612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:45.767633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 562/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:45.790099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972b54-17a8-408e-acb7-e249f3f6a8cf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:45.887785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972b54-17a8-408e-acb7-e249f3f6a8cf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:45.919879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:45.920707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:45.921522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:45.921797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] PATH_INFO: `/v3/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:45.923276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] RBAC: Authorizing `identity:get_role(role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:45.924624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:45.925994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 558/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:45 2022] GET /identity/v3/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:45.931739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:45.954343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:46.028166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3063ab8-ff01-473f-ba5b-787f890ed302 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:46.061871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:46.062774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:46.063062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:46.063342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] PATH_INFO: `/v3/users/8446e00e705c48fb930816dbf90b66cf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:46.064526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] RBAC: Authorizing `identity:get_user(user_id=8446e00e705c48fb930816dbf90b66cf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:46.065953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:46.067635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 563/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:45 2022] GET /identity/v3/users/8446e00e705c48fb930816dbf90b66cf => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:46.073484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:46.100790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:46.169925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69447dd-0992-46f0-8b50-f457364669d0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:46.201694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2771a-2fea-46d3-9427-ee133ae7c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:46.203033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2771a-2fea-46d3-9427-ee133ae7c72d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:46.203316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2771a-2fea-46d3-9427-ee133ae7c72d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:46.203589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2771a-2fea-46d3-9427-ee133ae7c72d None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:46.204761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2771a-2fea-46d3-9427-ee133ae7c72d None admin] RBAC: Authorizing `identity:get_project(project_id=7a6a9f0341e94ff39a5b49371f25f01b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:46.206166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2771a-2fea-46d3-9427-ee133ae7c72d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:46.207854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 559/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:46 2022] GET /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:46.213722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:46.300772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:46.310034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0d297-0fa4-4f8c-8f38-a8d0f740e264 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:46.342666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcbc1d-595b-4642-8533-1f190eddaade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:46.343537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbc1d-595b-4642-8533-1f190eddaade None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:46.343824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbc1d-595b-4642-8533-1f190eddaade None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:46.344104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcbc1d-595b-4642-8533-1f190eddaade None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b/users/8446e00e705c48fb930816dbf90b66cf/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:46.346318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcbc1d-595b-4642-8533-1f190eddaade None admin] RBAC: Authorizing `identity:create_grant(project_id=7a6a9f0341e94ff39a5b49371f25f01b, user_id=8446e00e705c48fb930816dbf90b66cf, role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:46.347739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcbc1d-595b-4642-8533-1f190eddaade None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:46.360870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 564/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:58:46 2022] PUT /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b/users/8446e00e705c48fb930816dbf90b66cf/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:58:48.340416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835c80-ab4f-4ac6-a127-4e22204e5052 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:48.341013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835c80-ab4f-4ac6-a127-4e22204e5052 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:48.341013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835c80-ab4f-4ac6-a127-4e22204e5052 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:48.342286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 560/1124] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:48.348097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:48.348475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:48.348655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:48.365572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:48.367014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:48.430720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:48.454653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79835c80-ab4f-4ac6-a127-4e22204e5052 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:48.545314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:48.552663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79835c80-ab4f-4ac6-a127-4e22204e5052 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:48.585003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:48.585837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:48.586120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:48.586430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] PATH_INFO: `/v3/roles/6e38c7daef8f4d7babf33337aaf879dd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:48.587884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] RBAC: Authorizing `identity:get_role(role_id=6e38c7daef8f4d7babf33337aaf879dd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:48.589236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:48.590678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 561/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:48 2022] GET /identity/v3/roles/6e38c7daef8f4d7babf33337aaf879dd => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:48.596148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:48.673107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:48.692766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca70c0-40a5-4d70-93a8-5ae66580c9b5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:48.725256 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:48.726108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:48.726416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:48.726690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] PATH_INFO: `/v3/users/8446e00e705c48fb930816dbf90b66cf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:48.727867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] RBAC: Authorizing `identity:get_user(user_id=8446e00e705c48fb930816dbf90b66cf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:48.729294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:48.730926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 566/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:48 2022] GET /identity/v3/users/8446e00e705c48fb930816dbf90b66cf => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:48.737252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:48.833029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f150ad-3067-4060-93da-04c8650bd4fc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:48.865721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:48.866381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:48.866668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:48.867201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:48.897079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:48.932278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:48.933701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:49.028038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:49.034563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:49.129885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb752d-51d4-4c07-b1ac-ff9256897bed None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:49.164270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be862b14-1b4c-4e71-bb95-672b3dc7663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:49.165105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862b14-1b4c-4e71-bb95-672b3dc7663b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:49.165384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862b14-1b4c-4e71-bb95-672b3dc7663b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:49.165656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862b14-1b4c-4e71-bb95-672b3dc7663b None admin] PATH_INFO: `/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:49.166829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be862b14-1b4c-4e71-bb95-672b3dc7663b None admin] RBAC: Authorizing `identity:get_project(project_id=7a6a9f0341e94ff39a5b49371f25f01b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:49.168329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be862b14-1b4c-4e71-bb95-672b3dc7663b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:49.169974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 567/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:49 2022] GET /identity/v3/projects/7a6a9f0341e94ff39a5b49371f25f01b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:49.175965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:49.235713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:49.272814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eb904-f455-4a30-85b1-8a062ef00090 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:49.306421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:49.307061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:49.307347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:49.307631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:49.308459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] RBAC: Adding query filter params (role.id=6e38c7daef8f4d7babf33337aaf879dd, scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b, user.id=8446e00e705c48fb930816dbf90b66cf) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:49.308776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:49.310180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27e7ca-77f6-4d00-bfdd-34bd23a8cfcf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:49.315906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 563/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:49 2022] GET /identity/v3/role_assignments?user.id=8446e00e705c48fb930816dbf90b66cf&scope.project.id=7a6a9f0341e94ff39a5b49371f25f01b&role.id=6e38c7daef8f4d7babf33337aaf879dd => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:51.314901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93da55-3ed4-4b6c-85a2-afbfa4f2db6a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:51.315404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93da55-3ed4-4b6c-85a2-afbfa4f2db6a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:51.315404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93da55-3ed4-4b6c-85a2-afbfa4f2db6a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:51.316734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 568/1131] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:51.321876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:51.322276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:51.322461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:51.339375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:51.340576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:51.404259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 564/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:51.427406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93da55-3ed4-4b6c-85a2-afbfa4f2db6a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:51.445317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:51.526437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93da55-3ed4-4b6c-85a2-afbfa4f2db6a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:51.558892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502c1e-06c7-4476-914e-0b8faa910ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:51.559669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502c1e-06c7-4476-914e-0b8faa910ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:51.559957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502c1e-06c7-4476-914e-0b8faa910ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:51.560235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502c1e-06c7-4476-914e-0b8faa910ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:51.562010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502c1e-06c7-4476-914e-0b8faa910ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:51.563475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502c1e-06c7-4476-914e-0b8faa910ba2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:51.565112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 569/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:51.570927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:51.626754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:51.666656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b961-7f8d-4bb0-86ef-c747e7344ce0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:51.699618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f1037-b031-456d-86c0-9736f99384a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:51.700263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f1037-b031-456d-86c0-9736f99384a9 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:51.700551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f1037-b031-456d-86c0-9736f99384a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:51.700828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f1037-b031-456d-86c0-9736f99384a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:51.701537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f1037-b031-456d-86c0-9736f99384a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:51.702999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f1037-b031-456d-86c0-9736f99384a9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:51.727147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 565/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:58:51 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:53.752361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bab06-877b-46d5-87d5-f4dc2ed69c9e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:53.752910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bab06-877b-46d5-87d5-f4dc2ed69c9e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:53.752910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bab06-877b-46d5-87d5-f4dc2ed69c9e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:53.754311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 570/1135] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:53.759464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:53.759878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:53.760026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:53.777015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:53.778197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:53.843339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 566/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:53.868265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bab06-877b-46d5-87d5-f4dc2ed69c9e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:53.949473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:53.966254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bab06-877b-46d5-87d5-f4dc2ed69c9e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:53.999391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35b485-819f-44d3-9ca0-30a0ec89339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:54.000158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35b485-819f-44d3-9ca0-30a0ec89339a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:54.000438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35b485-819f-44d3-9ca0-30a0ec89339a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:54.000708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35b485-819f-44d3-9ca0-30a0ec89339a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:54.001878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35b485-819f-44d3-9ca0-30a0ec89339a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:54.003387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35b485-819f-44d3-9ca0-30a0ec89339a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:54.004909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 571/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 08:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:54.010508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:54.051447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:54.108147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7c32-a9db-4d74-a1f6-d8e817366256 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:54.141574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f69ea-5246-4127-bbff-f6abc96af3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:54.142262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f69ea-5246-4127-bbff-f6abc96af3a4 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:54.142547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f69ea-5246-4127-bbff-f6abc96af3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:54.142825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f69ea-5246-4127-bbff-f6abc96af3a4 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:54.143531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f69ea-5246-4127-bbff-f6abc96af3a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:54.144950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f69ea-5246-4127-bbff-f6abc96af3a4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:54.163536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 567/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:58:54 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:58:56.185809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58722-7868-469d-aaa1-b9811f440352 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:56.186913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58722-7868-469d-aaa1-b9811f440352 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:56.186913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58722-7868-469d-aaa1-b9811f440352 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:56.188285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 572/1139] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:56.193475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:56.193854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:56.194027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:56.210191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:56.211388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:56.274924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 568/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:56.299198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58722-7868-469d-aaa1-b9811f440352 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:56.396017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58722-7868-469d-aaa1-b9811f440352 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:56.428890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:56.429656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:56.429937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:56.430211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:56.440007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:56.447575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:56.448739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:56.450077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 573/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:56.454566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:56.480574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:56.551641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8789be-a68e-4651-9423-699ef30ff969 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:56.584484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:56.585143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:56.585427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:56.585705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:56.586477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:56.586786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:56.588143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:56.596450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 569/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:56.602081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:56.617770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:56.698837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365d58b-0d68-481b-a123-bedbb7c48de2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:56.731403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:56.732258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:56.732537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:56.732807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] PATH_INFO: `/v3/users/e2c3142faf4e49aca213045a69994661` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:56.745613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c3142faf4e49aca213045a69994661)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:56.747095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:56.748713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 574/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:56 2022] GET /identity/v3/users/e2c3142faf4e49aca213045a69994661 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:56.754414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:56.839557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:56.851935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a90000-0762-4576-ae92-f5793cd6be8e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:56.885302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:56.885940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:56.886250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:56.886533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:56.950648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:56.952568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:57.036036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:57.048704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:58:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:57.054470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:57.122659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:57.153411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d73af-c2e2-410e-a2df-5df00959e7e3 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:57.185375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a4f4b-b61a-4b97-8483-58e34e01418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:57.186742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4f4b-b61a-4b97-8483-58e34e01418d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:57.187286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4f4b-b61a-4b97-8483-58e34e01418d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:57.187286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4f4b-b61a-4b97-8483-58e34e01418d None admin] PATH_INFO: `/v3/projects/ff70c1d468314615880b16877810ad2a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:57.188462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a4f4b-b61a-4b97-8483-58e34e01418d None admin] RBAC: Authorizing `identity:get_project(project_id=ff70c1d468314615880b16877810ad2a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:57.189880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a4f4b-b61a-4b97-8483-58e34e01418d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:57.191581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 575/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:57 2022] GET /identity/v3/projects/ff70c1d468314615880b16877810ad2a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:57.197443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:57.293046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c060-f8bf-4dbd-bebd-433552817dfa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:57.325657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:57.326320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:57.326609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:57.327447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:57.328274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=ff70c1d468314615880b16877810ad2a, user.id=e2c3142faf4e49aca213045a69994661) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:57.328590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:57.329989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441f8e0-a114-406f-9279-f4603ab3f480 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:57.335277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 571/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:58:57 2022] GET /identity/v3/role_assignments?user.id=e2c3142faf4e49aca213045a69994661&scope.project.id=ff70c1d468314615880b16877810ad2a&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:59.317896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382a1dc-96d9-40f4-8f4a-6fdbd90ad9ed None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:59.318438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382a1dc-96d9-40f4-8f4a-6fdbd90ad9ed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:59.318438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382a1dc-96d9-40f4-8f4a-6fdbd90ad9ed None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:59.319757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 576/1147] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:58:59.324878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:59.325291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:59.325432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:59.341608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:58:59.343306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:58:59.387776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:59.407343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 572/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:58:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:58:59.430582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382a1dc-96d9-40f4-8f4a-6fdbd90ad9ed None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:59.528438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382a1dc-96d9-40f4-8f4a-6fdbd90ad9ed None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:59.561454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:59.562255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:59.562540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:59.562819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:59.569418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:59.573359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:58:59.581259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:58:59.582378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:58:59.583412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 577/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:58:59.588569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:59.684097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386b281-0559-4b86-bab4-0074ead84f96 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:59.716628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:59.717284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:59.718124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:59.718434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:59.719185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:58:59.719497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:59.720858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:59.728721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 573/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:58:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:58:59.734353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:59.831747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7cce-9d83-4039-a03d-4f9ae11f721d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:59.863917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:59.864770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:59.865057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:59.865337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] PATH_INFO: `/v3/users/e2c3142faf4e49aca213045a69994661` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:59.866540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c3142faf4e49aca213045a69994661)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:59.868222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:59.869815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 578/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:58:59 2022] GET /identity/v3/users/e2c3142faf4e49aca213045a69994661 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:58:59.875355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:59.920309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:59.972490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db022e1-af1e-4c1d-b976-a8e6fe08bf89 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:00.004350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f77ac-36d5-454d-a323-396faf491b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:00.005205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f77ac-36d5-454d-a323-396faf491b05 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:00.005490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f77ac-36d5-454d-a323-396faf491b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:00.005767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f77ac-36d5-454d-a323-396faf491b05 None admin] PATH_INFO: `/v3/projects/ff70c1d468314615880b16877810ad2a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:00.006974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f77ac-36d5-454d-a323-396faf491b05 None admin] RBAC: Authorizing `identity:get_project(project_id=ff70c1d468314615880b16877810ad2a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:00.008391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f77ac-36d5-454d-a323-396faf491b05 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:00.010079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 574/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:58:59 2022] GET /identity/v3/projects/ff70c1d468314615880b16877810ad2a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:00.016359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:00.079238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:00.113463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05429cb3-a9ce-4c49-80f3-c41ec8a82076 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:00.146037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b88c-94b7-4fe8-825a-b88627fb2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:00.146935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b88c-94b7-4fe8-825a-b88627fb2a0f None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:00.147216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b88c-94b7-4fe8-825a-b88627fb2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:00.147489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b88c-94b7-4fe8-825a-b88627fb2a0f None admin] PATH_INFO: `/v3/projects/ff70c1d468314615880b16877810ad2a/users/e2c3142faf4e49aca213045a69994661/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:00.149404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b88c-94b7-4fe8-825a-b88627fb2a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=ff70c1d468314615880b16877810ad2a, user_id=e2c3142faf4e49aca213045a69994661, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:00.150846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b88c-94b7-4fe8-825a-b88627fb2a0f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:00.162617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 579/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:59:00 2022] PUT /identity/v3/projects/ff70c1d468314615880b16877810ad2a/users/e2c3142faf4e49aca213045a69994661/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:59:02.145815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8e98-e83e-457b-8cd2-b012bdcc77b6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:02.146316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8e98-e83e-457b-8cd2-b012bdcc77b6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:02.146428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb8e98-e83e-457b-8cd2-b012bdcc77b6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:02.147770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 575/1154] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:02.152819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:02.153238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:02.153382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:02.169674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:02.171374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:02.234365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 580/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:02.258271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8e98-e83e-457b-8cd2-b012bdcc77b6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:02.356491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb8e98-e83e-457b-8cd2-b012bdcc77b6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:02.369806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:02.390463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:02.391238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:02.391521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:02.391799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:02.401856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:59:02.409938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:59:02.411128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:59:02.411991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 576/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:59:02.417090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:02.471545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:02.519989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b3827-1592-4cdb-9019-20af058b49b3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:02.553965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:02.554653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:02.554939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:02.555217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:02.555961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:02.556268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:02.557633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:02.565403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 581/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:02.571298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:02.668361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0ff61-a1c1-49a5-96d8-30f72d0fa631 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:02.699937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:02.700788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:02.701154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:02.701437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] PATH_INFO: `/v3/users/e2c3142faf4e49aca213045a69994661` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:02.703398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c3142faf4e49aca213045a69994661)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:02.704823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:02.706497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 577/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:59:02 2022] GET /identity/v3/users/e2c3142faf4e49aca213045a69994661 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:02.711972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:02.807435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ea82-3d8b-4b35-98ac-093307d034ee None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:02.823789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:02.840984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:02.841621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:02.841901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:02.842174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:02.906769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:02.908200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:03.000805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 582/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:59:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:59:03.006557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:03.048111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:03.104445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d956c-06ce-4273-a1e8-6d23ccf8acf6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:03.137010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14013b39-7769-4ce4-9582-a68323dedf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:03.137863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013b39-7769-4ce4-9582-a68323dedf2a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:03.138148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013b39-7769-4ce4-9582-a68323dedf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:03.138456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013b39-7769-4ce4-9582-a68323dedf2a None admin] PATH_INFO: `/v3/projects/ff70c1d468314615880b16877810ad2a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:03.140175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14013b39-7769-4ce4-9582-a68323dedf2a None admin] RBAC: Authorizing `identity:get_project(project_id=ff70c1d468314615880b16877810ad2a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:03.141604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14013b39-7769-4ce4-9582-a68323dedf2a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:03.143328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 578/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:59:03 2022] GET /identity/v3/projects/ff70c1d468314615880b16877810ad2a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:03.149301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:03.167227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:03.245227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1856fa-150e-4890-9481-669b05bceb77 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:03.277353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:03.277938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:03.278248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:03.278535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:03.279365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=ff70c1d468314615880b16877810ad2a, user.id=e2c3142faf4e49aca213045a69994661) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:03.279684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:03.281604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7cb63-1a71-45c7-a77b-96375dd838e4 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:03.287296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 583/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:59:03 2022] GET /identity/v3/role_assignments?user.id=e2c3142faf4e49aca213045a69994661&scope.project.id=ff70c1d468314615880b16877810ad2a&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:05.307305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814942-488a-40fb-8bae-ccd84b1dac18 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:05.307825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814942-488a-40fb-8bae-ccd84b1dac18 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:05.307825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814942-488a-40fb-8bae-ccd84b1dac18 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:05.309177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 579/1162] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:05.314917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:05.315291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:05.315480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:05.332216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:05.333390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:05.397441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 584/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:05.419789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814942-488a-40fb-8bae-ccd84b1dac18 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:05.518958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814942-488a-40fb-8bae-ccd84b1dac18 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:05.527829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:05.553161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:05.553797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:05.554086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:05.554400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:05.619711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:05.621142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:05.715174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 580/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:59:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:59:05.721027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:05.735070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:05.816606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b551046-0803-4648-9ec0-79684d84ebce None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:05.848218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:05.848996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:05.849282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:05.849556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:05.855981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:05.857401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-8dfcf0c6-14cb-42ea-8a9a-3628297a01b6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:59:05.872003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:59:05.873232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:59:05.874903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 585/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 08:59:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:59:05.879634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:05.889437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:05.974351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712fa34-0549-4558-94ca-481dc0bdad6f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:06.007759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:06.008407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:06.008689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:06.008963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:06.009680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:06.009987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:06.011366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89438fe4-aab8-4f74-9227-9171c8374ee3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:06.018580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 581/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Fri Jun 24 08:59:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:08.003742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b0d9-e0c4-4509-b5c1-28288901130f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:08.004339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b0d9-e0c4-4509-b5c1-28288901130f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:08.004339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09b0d9-e0c4-4509-b5c1-28288901130f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:08.005676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 586/1167] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:08.010822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee696f-6124-40af-81e5-c2651a40d21a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:08.011209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee696f-6124-40af-81e5-c2651a40d21a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:08.011378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee696f-6124-40af-81e5-c2651a40d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:08.027760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aaee696f-6124-40af-81e5-c2651a40d21a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:08.029145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aaee696f-6124-40af-81e5-c2651a40d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:08.094121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 582/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:08.117303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b0d9-e0c4-4509-b5c1-28288901130f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:08.185613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:08.216127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09b0d9-e0c4-4509-b5c1-28288901130f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:08.248170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c0671-d74c-430f-b577-0ca70fcf00f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:08.248810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0671-d74c-430f-b577-0ca70fcf00f6 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:08.249634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0671-d74c-430f-b577-0ca70fcf00f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:08.249914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c0671-d74c-430f-b577-0ca70fcf00f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:08.250680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c0671-d74c-430f-b577-0ca70fcf00f6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:08.252032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c0671-d74c-430f-b577-0ca70fcf00f6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:08.265547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 587/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Fri Jun 24 08:59:08 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:59:10.380089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ff172-dda5-42ca-bc37-20a6cd0fdee3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:10.380589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ff172-dda5-42ca-bc37-20a6cd0fdee3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:10.380679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ff172-dda5-42ca-bc37-20a6cd0fdee3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:10.382027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 583/1170] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:59:10.387115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:10.387539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:10.387670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:10.404396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:10.406198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:10.469267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 588/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:10.491848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ff172-dda5-42ca-bc37-20a6cd0fdee3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:10.494952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:10.591117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ff172-dda5-42ca-bc37-20a6cd0fdee3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:10.623239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95578ab-ad36-475d-b98b-872ca5b36933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:10.624611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95578ab-ad36-475d-b98b-872ca5b36933 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:10.624892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95578ab-ad36-475d-b98b-872ca5b36933 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:10.625166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95578ab-ad36-475d-b98b-872ca5b36933 None admin] PATH_INFO: `/v3/domains/a40e962931564ccb9862f2f8a3a9647a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:10.635236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95578ab-ad36-475d-b98b-872ca5b36933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a40e962931564ccb9862f2f8a3a9647a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:10.636606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95578ab-ad36-475d-b98b-872ca5b36933 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:10.638208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 584/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Jun 24 08:59:10 2022] GET /identity/v3/domains/a40e962931564ccb9862f2f8a3a9647a => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:10.644408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:10.701649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:10.740210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c88d1c-13d5-4d65-9945-2969ecaf700d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:10.772682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcba4fc-acac-45e6-8e9f-c5f967372bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:10.773335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba4fc-acac-45e6-8e9f-c5f967372bf6 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:10.773622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba4fc-acac-45e6-8e9f-c5f967372bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:10.773899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcba4fc-acac-45e6-8e9f-c5f967372bf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:10.774630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba4fc-acac-45e6-8e9f-c5f967372bf6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:10.776051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcba4fc-acac-45e6-8e9f-c5f967372bf6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:10.800832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 589/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 08:59:10 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:59:12.815103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122f02c-4bf7-4620-a8e6-032a4a5ff3ce None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:12.815648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122f02c-4bf7-4620-a8e6-032a4a5ff3ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:12.815648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122f02c-4bf7-4620-a8e6-032a4a5ff3ce None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:12.817017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 585/1174] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:12.822327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:12.822731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:12.822902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:12.839166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:12.840344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:12.905611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:12.929954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122f02c-4bf7-4620-a8e6-032a4a5ff3ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:12.990298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:13.031526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122f02c-4bf7-4620-a8e6-032a4a5ff3ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:13.064068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244e6d4-d066-482f-b402-8990b8d0a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:13.064917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244e6d4-d066-482f-b402-8990b8d0a017 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:13.065247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244e6d4-d066-482f-b402-8990b8d0a017 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:13.065475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244e6d4-d066-482f-b402-8990b8d0a017 None admin] PATH_INFO: `/v3/domains/a40e962931564ccb9862f2f8a3a9647a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:13.066665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244e6d4-d066-482f-b402-8990b8d0a017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a40e962931564ccb9862f2f8a3a9647a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:13.068086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244e6d4-d066-482f-b402-8990b8d0a017 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:13.069691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 586/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Fri Jun 24 08:59:12 2022] GET /identity/v3/domains/a40e962931564ccb9862f2f8a3a9647a => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:13.075361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:13.119811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:13.173304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0bce6-af26-4def-9d0f-a6c232c6b0a3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:13.205705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a787d-1221-434f-a18e-694ad6fd3538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:13.206380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a787d-1221-434f-a18e-694ad6fd3538 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:13.206669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a787d-1221-434f-a18e-694ad6fd3538 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:13.206941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a787d-1221-434f-a18e-694ad6fd3538 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:13.207642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a787d-1221-434f-a18e-694ad6fd3538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:13.209049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a787d-1221-434f-a18e-694ad6fd3538 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:13.227445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 591/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 08:59:13 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:59:15.270533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47f180-6d28-4d16-b854-b0bc03b8ef8b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:15.271059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47f180-6d28-4d16-b854-b0bc03b8ef8b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:15.271162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47f180-6d28-4d16-b854-b0bc03b8ef8b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:15.272470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 587/1178] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:15.277537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d392834-f273-4f34-8094-7339a640548b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:15.277899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d392834-f273-4f34-8094-7339a640548b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:15.278093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d392834-f273-4f34-8094-7339a640548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:15.294880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8d392834-f273-4f34-8094-7339a640548b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:15.296637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8d392834-f273-4f34-8094-7339a640548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:15.359797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 592/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:15.383638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47f180-6d28-4d16-b854-b0bc03b8ef8b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:15.482052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47f180-6d28-4d16-b854-b0bc03b8ef8b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:15.509457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:15.516120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:15.516895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:15.517177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:15.517452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:15.527241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:59:15.535286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:59:15.536206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:59:15.537221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 588/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:59:15.542549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d392834-f273-4f34-8094-7339a640548b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:15.570453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:15.637873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d392834-f273-4f34-8094-7339a640548b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:15.671249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:15.671897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:15.672181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:15.672457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:15.673199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:15.673504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:15.674891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:15.682568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 593/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:15.688106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:15.785886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b8b78-ea1d-4588-a5a2-7df94b771622 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:15.817901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:15.818773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:15.819054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:15.819325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] PATH_INFO: `/v3/users/827f5cb3d1574ce4aeac9105e49275e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:15.832240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] RBAC: Authorizing `identity:get_user(user_id=827f5cb3d1574ce4aeac9105e49275e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:15.833600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:15.835272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 589/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:59:15 2022] GET /identity/v3/users/827f5cb3d1574ce4aeac9105e49275e1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:15.840790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:15.928817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:15.937766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c352f-1f5f-45c3-a1f2-fe727ef00aa5 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:15.969898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:15.970562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:15.970850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:15.971129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:16.035332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:16.036757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:16.121305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:16.131300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 594/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:59:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:59:16.137251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:16.184793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:16.232851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478c74f-60db-49e9-96b8-ec36f4ba128a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:16.265944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27990d-7b15-43ea-a49f-c03c3a22752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:16.266805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27990d-7b15-43ea-a49f-c03c3a22752d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:16.267085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27990d-7b15-43ea-a49f-c03c3a22752d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:16.267353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27990d-7b15-43ea-a49f-c03c3a22752d None admin] PATH_INFO: `/v3/projects/897ebf24c1bb4961846e97b291198125` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:16.268507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27990d-7b15-43ea-a49f-c03c3a22752d None admin] RBAC: Authorizing `identity:get_project(project_id=897ebf24c1bb4961846e97b291198125)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:16.270011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27990d-7b15-43ea-a49f-c03c3a22752d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:16.271688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 590/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:59:16 2022] GET /identity/v3/projects/897ebf24c1bb4961846e97b291198125 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:16.277560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:16.372462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47590927-bbed-489d-93e2-3cf72e8484d6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:16.404853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:16.405522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:16.405808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:16.406091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:16.406944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=897ebf24c1bb4961846e97b291198125, user.id=827f5cb3d1574ce4aeac9105e49275e1) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:16.407261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:16.408676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dd837-1908-40f0-b68a-a4b457383b38 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:16.413932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 595/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:59:16 2022] GET /identity/v3/role_assignments?user.id=827f5cb3d1574ce4aeac9105e49275e1&scope.project.id=897ebf24c1bb4961846e97b291198125&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:18.389019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb29df-1002-4f55-bd62-0119ae921c3c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:18.390058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb29df-1002-4f55-bd62-0119ae921c3c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:18.390149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb29df-1002-4f55-bd62-0119ae921c3c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:18.391509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 591/1186] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:18.396714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:18.397225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:18.397322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:18.414005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:18.415196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:18.462152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:18.478500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 596/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:18.501023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb29df-1002-4f55-bd62-0119ae921c3c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:18.599170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb29df-1002-4f55-bd62-0119ae921c3c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:18.614807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:18.632617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:18.633389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:18.633670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:18.633944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:18.644220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:59:18.651670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:59:18.652774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 08:59:18.653803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 592/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:59:18.659355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:18.754230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338c57f-540d-44ea-aeb7-bf7843cc719d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:18.793817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:18.794507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:18.794793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:18.795072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:18.795829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:18.796134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:18.797504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:18.808603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 597/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:18.814790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:18.911886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffb0c4-8d7f-4d3f-b3a1-616ecdd33186 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:18.943766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:18.944628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:18.944914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:18.945400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] PATH_INFO: `/v3/users/827f5cb3d1574ce4aeac9105e49275e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:18.946673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] RBAC: Authorizing `identity:get_user(user_id=827f5cb3d1574ce4aeac9105e49275e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:18.948107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:18.949716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 593/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:59:18 2022] GET /identity/v3/users/827f5cb3d1574ce4aeac9105e49275e1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:18.956114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:19.004204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:19.054348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187dd7c-4971-4eaa-9b6a-743befd3ed1d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:19.086731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e30a2-aa10-47c7-85a0-28f6ba8ccd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:19.087576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e30a2-aa10-47c7-85a0-28f6ba8ccd7e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:19.087856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e30a2-aa10-47c7-85a0-28f6ba8ccd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:19.088129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e30a2-aa10-47c7-85a0-28f6ba8ccd7e None admin] PATH_INFO: `/v3/projects/897ebf24c1bb4961846e97b291198125` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:19.089287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e30a2-aa10-47c7-85a0-28f6ba8ccd7e None admin] RBAC: Authorizing `identity:get_project(project_id=897ebf24c1bb4961846e97b291198125)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:19.090759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e30a2-aa10-47c7-85a0-28f6ba8ccd7e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:19.092418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 598/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:59:18 2022] GET /identity/v3/projects/897ebf24c1bb4961846e97b291198125 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:19.098177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:19.143447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:19.196682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cbe7d-9e24-4aac-9c79-a0e4cd95eb18 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:19.228014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f91c9-646a-4624-accc-f62daf3e7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:19.228883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f91c9-646a-4624-accc-f62daf3e7739 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:19.229161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f91c9-646a-4624-accc-f62daf3e7739 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:19.229433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f91c9-646a-4624-accc-f62daf3e7739 None admin] PATH_INFO: `/v3/projects/897ebf24c1bb4961846e97b291198125/users/827f5cb3d1574ce4aeac9105e49275e1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:19.231393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f91c9-646a-4624-accc-f62daf3e7739 None admin] RBAC: Authorizing `identity:create_grant(project_id=897ebf24c1bb4961846e97b291198125, user_id=827f5cb3d1574ce4aeac9105e49275e1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:19.232798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f91c9-646a-4624-accc-f62daf3e7739 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:19.246481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 594/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 08:59:19 2022] PUT /identity/v3/projects/897ebf24c1bb4961846e97b291198125/users/827f5cb3d1574ce4aeac9105e49275e1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:59:21.226890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2fc6-f9b3-444d-8c0c-e4f96dc10f13 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:21.227419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2fc6-f9b3-444d-8c0c-e4f96dc10f13 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:21.227522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2fc6-f9b3-444d-8c0c-e4f96dc10f13 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:21.228818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 599/1193] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 08:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:59:21.233901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:21.234306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:21.234489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:21.251589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:59:21.252772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:21.317364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 595/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 08:59:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:59:21.340936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2fc6-f9b3-444d-8c0c-e4f96dc10f13 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:21.439402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2fc6-f9b3-444d-8c0c-e4f96dc10f13 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:21.455118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:21.473023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:21.473799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:21.474083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:21.474391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:21.484600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:59:21.492152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:59:21.493560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 08:59:21.494554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 600/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 08:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:59:21.499428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:21.532798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:21.596667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d3288-01a7-4341-aa04-6244f91dd34e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:21.629883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:21.630567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:21.630850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:21.631124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:21.631861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:21.632166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:21.633517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:21.641242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 596/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 08:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:21.646961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:21.742907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b7597-912b-4be5-b0de-f16b8c1ec14b None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:21.776494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:21.777348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:21.777631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:21.777907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] PATH_INFO: `/v3/users/827f5cb3d1574ce4aeac9105e49275e1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:21.779111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] RBAC: Authorizing `identity:get_user(user_id=827f5cb3d1574ce4aeac9105e49275e1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:21.781072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:21.782713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 601/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Fri Jun 24 08:59:21 2022] GET /identity/v3/users/827f5cb3d1574ce4aeac9105e49275e1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:21.788304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:21.880215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:21.886106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca7f9c-3cd4-41ef-aa70-6281de4c90f9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:21.918550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:21.919184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:21.919470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:21.919748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:21.984538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:21.985959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:22.074199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:22.081062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 08:59:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:59:22.087021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:22.131770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:22.183381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa12a6-7813-48e5-8d86-f40fb08ffa4c None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:22.215684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef4aab-0a62-40e3-b101-b9af4fc16650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:22.216530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef4aab-0a62-40e3-b101-b9af4fc16650 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:22.216817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef4aab-0a62-40e3-b101-b9af4fc16650 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:22.217090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef4aab-0a62-40e3-b101-b9af4fc16650 None admin] PATH_INFO: `/v3/projects/897ebf24c1bb4961846e97b291198125` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:22.218870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef4aab-0a62-40e3-b101-b9af4fc16650 None admin] RBAC: Authorizing `identity:get_project(project_id=897ebf24c1bb4961846e97b291198125)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:22.220286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef4aab-0a62-40e3-b101-b9af4fc16650 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:22.221942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 602/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Fri Jun 24 08:59:22 2022] GET /identity/v3/projects/897ebf24c1bb4961846e97b291198125 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:22.227893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:22.322617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad017f7d-5161-4388-aebf-7459d8effb5e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:22.356048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:22.356696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:22.356982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:22.357261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:22.358147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=897ebf24c1bb4961846e97b291198125, user.id=827f5cb3d1574ce4aeac9105e49275e1) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:59:22.358493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:22.359923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d033-9c4f-40b0-b572-dca12ad364a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:22.365612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 598/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 08:59:22 2022] GET /identity/v3/role_assignments?user.id=827f5cb3d1574ce4aeac9105e49275e1&scope.project.id=897ebf24c1bb4961846e97b291198125&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:59:32.211657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=44 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:32.363014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=70 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:16.889527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b1698-f493-4d00-a1c1-6ff13d4b3375 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:16.890129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b1698-f493-4d00-a1c1-6ff13d4b3375 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:16.890129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b1698-f493-4d00-a1c1-6ff13d4b3375 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:16.891830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 603/1201] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:16.898713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:16.899178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:16.899281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:16.918009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:16.919540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:17.023523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:00:17.052500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b1698-f493-4d00-a1c1-6ff13d4b3375 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:17.184628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b1698-f493-4d00-a1c1-6ff13d4b3375 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:17.226581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:17.227360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:17.227719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:17.228013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:17.240590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:17.242110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:17.268440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:17.269694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:17.271022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:17.271022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:17.271022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:17.271022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:17.271022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 604/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:17.276136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:17.394506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75b101-2dbb-49a5-846f-16702668cdaf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:17.432020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:17.439620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:17.440402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:17.440731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:17.441212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:17.441962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:17.442329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:17.443670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6158b-4710-466f-9290-1ab31ccf5d5b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:17.468214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 600/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:17.469497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:17.547863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:17.611933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256bd68-dad1-49ad-a3fd-6d0f7861ab17 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:17.661080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73207dfc-058f-46de-9670-2e2ae1db30b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:17.661939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207dfc-058f-46de-9670-2e2ae1db30b2 None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:17.662210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207dfc-058f-46de-9670-2e2ae1db30b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:17.662516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207dfc-058f-46de-9670-2e2ae1db30b2 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:17.663436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207dfc-058f-46de-9670-2e2ae1db30b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:17.665069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207dfc-058f-46de-9670-2e2ae1db30b2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:17.696829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 605/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Fri Jun 24 09:00:17 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:00:19.860898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93a7df-f683-48b5-a628-0f31a947ab16 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:19.861458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93a7df-f683-48b5-a628-0f31a947ab16 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:19.861458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93a7df-f683-48b5-a628-0f31a947ab16 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:19.862965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 601/1206] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:19.868975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:19.869517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:19.869517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:19.888709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:19.889903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:19.965395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:19.991104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93a7df-f683-48b5-a628-0f31a947ab16 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:20.114518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93a7df-f683-48b5-a628-0f31a947ab16 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:20.155102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:20.155999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:20.156373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:20.156746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:20.169936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:00:20.178286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:20.179333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:00:20.180199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:20.182415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 602/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 09:00:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:20.186671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:20.238607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:20.309620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269fcdd-867d-4c30-9945-ff78b3a03dae None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:20.353934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:20.354644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:20.354951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:20.355236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:20.355993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:20.356369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:20.357794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:20.366394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 607/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 09:00:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:20.372948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:20.433395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:20.487978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c7179-ee5c-4bf1-96a3-0484f4166971 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:20.523799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:20.524606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:20.524886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:20.525164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:20.537498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:20.538963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:20.556326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:20.558672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:20.559787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:20.559787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:20.559787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:20.559787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:20.562259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 603/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:20.563993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:20.692021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:20.695107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d61902-1ace-4bf4-86cb-df47872bd314 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:20.737452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:20.738118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:20.738471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:20.738734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:20.739466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:20.739773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:20.741281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:20.756025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 608/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:20.761641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:20.881476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ae8f1-13fe-4e73-b244-d860322ed5ef None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:20.883292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:20.923774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:20.925256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:20.925643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:20.926043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:20.937971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:20.939530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:00:20.957148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:20.958200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:20.965677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 604/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:20.966485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:21.085191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124d25-e290-4ed9-9cbe-46ac99dbdf1e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:21.133353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:21.134312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:21.134697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:21.135091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:21.136076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:21.136510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:21.138363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:21.160922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 609/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 09:00:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:21.167975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:21.297523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572b550-9fb6-41b0-80e4-a8aa144d1a35 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:21.341114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:21.342788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:21.342902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:21.343146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:21.378505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:21.435016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:21.437237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:21.553575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 09:00:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:00:21.559592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:21.585410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:21.683429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6e0a-c0b5-43f2-97a1-4eb35f38bf54 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:21.720845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:21.721886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:21.722375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:21.722815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:21.736465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:21.738156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:21.758351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:21.761963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:21.762892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:21.762892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:21.762892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:21.762892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:21.762892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 610/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:21.766410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:21.835227 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:21.876741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3250cb-097f-43e0-9a17-6c08e4ca7944 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:21.912288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:21.913000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:21.913242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:21.913522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:21.914268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:21.914581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:21.915943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:21.932083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 606/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:21.935183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:22.014576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:22.054612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf663b2-f8b8-4f6c-89e0-ae1ed9261036 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:22.096656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:22.097451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:22.097725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:22.098002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:22.105835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:22.107443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:00:22.122039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:22.123231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:22.124139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 611/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 09:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:22.129123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:22.236903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95b24d-33c9-4060-a73a-7886d4972903 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:22.262864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:22.283313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:22.283987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:22.284272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:22.284551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:22.285352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:22.285694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:22.287156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55e686-9058-4720-9f7e-11aadfdd913b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:22.300239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 607/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 09:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:22.306083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:22.434373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af917faf-2cf1-4414-87df-45c5cabb68ee None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:22.471377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:22.478417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:22.479094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:22.479375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:22.479663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:22.480499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=c2b5e5bb5b614905b7ff314b54bf8097) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:22.480821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:22.482869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6ad80-ae90-458d-9f5d-e9d5759aabc6 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:22.489299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 612/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 09:00:22 2022] GET /identity/v3/role_assignments?user.id=c2b5e5bb5b614905b7ff314b54bf8097&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:24.589625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46382-3646-4689-ab59-01285aec1c63 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:24.590295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46382-3646-4689-ab59-01285aec1c63 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:24.590295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d46382-3646-4689-ab59-01285aec1c63 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:24.592454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 608/1220] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:00:24.597597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:24.598048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:24.598171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:24.616083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:24.617663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:24.688847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:24.711811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46382-3646-4689-ab59-01285aec1c63 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:24.831198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d46382-3646-4689-ab59-01285aec1c63 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:24.869250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:24.870210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:24.870609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:24.871002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:24.882889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:00:24.891221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:24.892288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:24.893157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 609/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 09:00:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:24.899110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:24.999981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e047672-f486-4623-943c-1c7ef70c228a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:25.026007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:25.041452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:25.042324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:25.042614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:25.042890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:25.043988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:25.044445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:25.046129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:25.057054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 614/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 09:00:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:25.062670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:25.109059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:25.175164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f49123-f4ea-4006-823b-21eb34622456 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:25.217516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:25.218919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:25.219385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:25.219675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:25.232449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:25.234127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:25.252731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:25.253888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:25.254892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:25.254892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:25.254892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:25.254892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:25.254892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 610/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:25.259966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:25.373162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02ae60-05a3-45a7-ba13-29b7974bfb96 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:25.407988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:25.408645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:25.408932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:25.409214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:25.409941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:25.410292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:25.411653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:25.423444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 615/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:25.429108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:25.524533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:25.532236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24be1e-da41-4847-9a65-ddfce63670c2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:25.566008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:25.566841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:25.567128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:25.567400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:25.576719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:25.578155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:00:25.592973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:25.594476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:25.595455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 611/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:25.599991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:25.648250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:25.707721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eff7e-8391-4566-8695-5718973e8186 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:25.748493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:25.749158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:25.749440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:25.749713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:25.750583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:25.750891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:25.752292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:25.775593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 616/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 09:00:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:25.782438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:25.904384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cae03-2923-44da-874a-81ab36e4229d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:25.939199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:25.940016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:25.940328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:25.940607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:25.952882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:25.954378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:25.973631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:25.974810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:25.975928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:25.975928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:25.975928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:25.975928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:25.975928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 612/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:25.982772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:26.095012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579797-b4f4-4ef8-986d-c3cfde4c9936 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:26.097365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:26.134595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:26.135313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:26.135667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:26.135941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:26.136691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:26.137100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:26.139378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:26.151787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 617/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:26.158473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:26.168103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:26.271618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353eb31-cb01-4091-94e4-624841621cc2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:26.305877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:26.306804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:26.307082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:26.307365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:26.314680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:26.316113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:00:26.330806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:26.331917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:26.332862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 613/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 09:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:26.337804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:26.456387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5952fa6-a92b-444d-934a-37ad793ba7bb None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:26.498657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:26.499848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:26.500171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:26.500713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:26.501711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:26.502023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:26.503985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7f1ea-69b7-4e6b-a11e-6e174ed055ad None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:26.520341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 618/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 09:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:26.526474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:26.595808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:26.632184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fce658-91bf-4a86-b1cc-e21b8b9b06d3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:26.667469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77de8de-c7be-4e8c-b74d-6d9c0872431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:26.668355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de8de-c7be-4e8c-b74d-6d9c0872431f None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:26.668633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de8de-c7be-4e8c-b74d-6d9c0872431f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:26.668905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de8de-c7be-4e8c-b74d-6d9c0872431f None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/c2b5e5bb5b614905b7ff314b54bf8097/roles/a31829f5e908410ebfd3008fba28a73d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:26.686142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77de8de-c7be-4e8c-b74d-6d9c0872431f None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=c2b5e5bb5b614905b7ff314b54bf8097, role_id=a31829f5e908410ebfd3008fba28a73d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:26.687626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77de8de-c7be-4e8c-b74d-6d9c0872431f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:26.700297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 09:00:26 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/c2b5e5bb5b614905b7ff314b54bf8097/roles/a31829f5e908410ebfd3008fba28a73d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:00:28.988450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36600-131a-43b5-b0c5-3bc0dd50dbdb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:28.989014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36600-131a-43b5-b0c5-3bc0dd50dbdb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:28.989014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd36600-131a-43b5-b0c5-3bc0dd50dbdb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:28.990413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 619/1233] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:28.996632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:28.997111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:28.997527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:29.016556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:29.018198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:29.096815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:00:29.122091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd36600-131a-43b5-b0c5-3bc0dd50dbdb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:29.150750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:29.235935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd36600-131a-43b5-b0c5-3bc0dd50dbdb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:29.272967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:29.273689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:29.273977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:29.274279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:29.285602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:00:29.294640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:29.295971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:29.297332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 620/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Fri Jun 24 09:00:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:29.302064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:29.348865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:29.410216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd48f7b-61d3-41e1-935a-8b9cc95e05f2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:29.453611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:29.454346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:29.454632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:29.454910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:29.455693 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:29.455976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:29.457384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:29.470751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 616/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Fri Jun 24 09:00:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:29.472300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:29.569161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:29.586044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef7be2-3274-4926-9dfa-570ae8fad15d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:29.623830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:29.624704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:29.625197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:29.625563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:29.638970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:29.640524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:29.659240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:29.660520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:29.661775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:29.661775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:29.661775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:29.661775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:29.666677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 621/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:29.666836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:29.779513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4bf45-5502-4c9f-add0-1dff26bff19a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:29.791701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:29.819676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:29.820242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:29.820592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:29.820957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:29.821653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:29.821960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:29.823359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:29.836215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 617/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:29.842324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:29.953866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcddac-0229-4eab-aae0-2cc3bb881f30 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:29.988908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:29.989705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:29.989982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:29.990294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:29.993988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:29.999583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:30.001370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:00:30.016301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:30.018515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:30.019829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 622/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:30.023699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:30.139755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22211505-7d4d-4ab7-a820-59a37e77d5e5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:30.177076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:30.177746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:30.178031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:30.178346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:30.179199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:30.179525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:30.181101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:30.200110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 618/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 09:00:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:30.206587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:30.327052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2d38e-77a0-4d27-a4df-bff32eb4419f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:30.363498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:30.364163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:30.364431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:30.364745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:30.432258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:30.440174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:30.441747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:30.551845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 09:00:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 09:00:30.557816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:30.587904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:30.668495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3a723-5043-40c0-ad9c-0a817c9b762d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:30.703240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:30.703944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:30.704230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:30.704531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:30.714966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:30.717141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:30.736535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:30.737626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:30.738734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:30.738734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:30.738734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:30.738734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:30.738734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 619/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:30.743887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:30.853445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:30.860303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b258df-bd33-43d7-bb63-b96646eea866 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:30.896394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:30.897060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:30.897345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:30.897625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:30.898853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:30.899167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:30.900533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:30.913291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 624/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:30.919278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:31.009886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:31.037753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d32b2-682c-4437-b7bc-dbf817558ce5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:31.084899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:31.085769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:31.086257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:31.086637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:31.094559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:31.096283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:00:31.114161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:31.115311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:31.116445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 620/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 09:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:00:31.122054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:31.230486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66864fa4-c73a-4daf-885d-4bb3f6f17c3a None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:31.267925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:31.268525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:31.268789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:31.269146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:31.269909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:31.270241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:31.271656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7960e6a-e049-42b7-a69a-ad379937d3b2 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:31.284654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 625/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 09:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:00:31.291824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:31.400394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aaa15-7666-43ac-8c2e-02103f2743d8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:31.435235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:31.435893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:31.436174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:31.436521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:31.437281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] RBAC: Adding query filter params (role.id=a31829f5e908410ebfd3008fba28a73d, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=c2b5e5bb5b614905b7ff314b54bf8097) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:31.437595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:31.439044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b11a5-b647-44fd-a8f3-5bdb251d7e8a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:31.445526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 621/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 09:00:31 2022] GET /identity/v3/role_assignments?user.id=c2b5e5bb5b614905b7ff314b54bf8097&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a31829f5e908410ebfd3008fba28a73d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:33.866201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934837c-b40f-4468-b647-7cfae87b8b44 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:33.866759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934837c-b40f-4468-b647-7cfae87b8b44 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:33.866759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934837c-b40f-4468-b647-7cfae87b8b44 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:33.868770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 626/1247] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:33.874724 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:33.875179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:33.875282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:33.880519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:33.896258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:33.897819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:33.976270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:34.005762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934837c-b40f-4468-b647-7cfae87b8b44 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:34.027713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:34.123579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934837c-b40f-4468-b647-7cfae87b8b44 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:34.160316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:34.161204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:34.161502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:34.161836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:34.174086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:00:34.183219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:34.184371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:34.185956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 627/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 09:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:34.191399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:34.312679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022dd1d-1f39-4ca5-a271-6e41be5d8524 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:34.348123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:34.353536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:34.354570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:34.354939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:34.355476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:34.356284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:34.356697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:34.358111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:34.367046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 623/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 09:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:34.373500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:34.460310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:34.484255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eda08-09b6-4593-bb60-11de359f86e2 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:34.519418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:34.520213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:34.520490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:34.520761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:34.532381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:34.533129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:34.553854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:34.555061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:34.556127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:34.556127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:34.556127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:34.556127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:34.556127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 628/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:00:34.561565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:34.679345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce9dd3-0547-457d-84bd-38830cbafc39 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:34.718300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:34.718891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:34.719173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:34.719447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:34.720163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:34.720466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:34.721822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:34.738262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 624/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:34.740923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:34.873272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e154b-650c-4cca-9a1e-8b48a0d97f30 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:34.900778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:34.910212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:34.911061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:34.911350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:34.911670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:34.919690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:34.921148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:00:34.937284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:34.938552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:34.939893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:34.942290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 629/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:34.947808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:35.010356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:35.063028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eafded-2cd6-4e8c-bd15-ef6f7969024d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:35.102990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:35.103819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:35.104120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:35.104417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:35.105331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:35.105652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:35.107806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:35.126706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 625/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 09:00:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:35.132569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:35.238146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d8713-1bb3-494d-8876-144b7af64485 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:35.274285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:35.274971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:35.275315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:35.275580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:35.347737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:35.366017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:35.367543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:35.485240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 09:00:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:00:35.486531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:35.593756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a56ef3-77b1-4148-a59b-8bf919826714 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:35.610647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:35.634905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:35.635777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:35.636093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:35.636387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:35.648741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:35.650362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:35.671957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:35.673085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:35.674436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:35.674436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:35.674436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:35.674436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:35.674436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 626/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:35.679064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:35.778373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:35.799534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8514e5-1bcf-4bb1-b703-22c505b57cca None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:35.843410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:35.844124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:35.844365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:35.844617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:35.845340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:35.845668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:35.847033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:35.858358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 631/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:35.865680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:35.977731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a654af-474c-4e01-b58e-45c498a0fb1f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:36.015536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:36.016362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:36.016654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:36.016932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:36.024775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:36.026287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:00:36.041389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:36.042622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:36.049358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 627/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 09:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:36.049944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:36.157641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9684a-a736-477f-8f6f-5c22a3d418b0 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:36.193957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:36.194672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:36.194952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:36.195227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:36.196051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:36.196360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:36.197804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208bf97-94a8-4f17-adba-6dc8d7bdd5ef None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:36.211415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 632/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 09:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:36.218286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:36.245864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:36.324362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21f5db-80f2-4af2-af3f-e6ecf2a9fa28 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:36.359654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:36.360309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:36.360588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:36.360862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:36.361697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=c2b5e5bb5b614905b7ff314b54bf8097) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:36.362006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:36.363488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be2520-ab12-4ed3-9a04-13ff0e74ef2f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:36.369804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 628/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 09:00:36 2022] GET /identity/v3/role_assignments?user.id=c2b5e5bb5b614905b7ff314b54bf8097&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:38.360857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ca3a-30b4-468f-829f-7db599f3109e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:38.361392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ca3a-30b4-468f-829f-7db599f3109e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:38.361392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528ca3a-30b4-468f-829f-7db599f3109e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:38.362804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 633/1261] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:38.367827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:38.368207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:38.368386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:38.384943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:38.386114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:38.449430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:38.472310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528ca3a-30b4-468f-829f-7db599f3109e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:38.482966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:38.570144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528ca3a-30b4-468f-829f-7db599f3109e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:38.602881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:38.603661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:38.603975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:38.604281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:38.614646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:00:38.622878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:38.623975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:38.624997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 634/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 09:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:38.629973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:38.647625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:38.725384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e0a4-90b0-405f-8e63-b064016cca8d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:38.758200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:38.758878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:38.759164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:38.759441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:38.760184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:38.760486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:38.761867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:38.770187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 630/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 09:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:38.775977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:38.848126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:38.881211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf6672-8267-4776-b6d2-f9d179f0d4c6 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:38.913560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:38.914370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:38.914655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:38.914931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:38.925656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:38.927118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:38.943902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:38.944928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:38.946052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:38.946052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:38.946052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:38.946052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:38.946052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 635/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:00:38.951469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.029392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:39.048648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18f07b-f61d-4950-80f5-d7f6b3c197ab None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:39.080916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:39.081564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:39.081848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:39.082126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:39.082876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:39.083185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:39.084550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:39.095846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 631/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:39.101463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.197747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191db7fd-354e-4f6c-9a31-5a0bf3e39368 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:39.216065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:39.229588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:39.230411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:39.230696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:39.230971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:39.238699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:39.240109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:00:39.254608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:39.255653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:39.256615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 636/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:39.261413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.358324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd8f39-d70b-44bb-88cc-6094f11280c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:39.391193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:39.391854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:39.392134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:39.392408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:39.393240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:39.393549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:39.395047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:39.403415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:39.411922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 632/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 09:00:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:39.417492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.512551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8366ed8-7657-467d-9980-c0786f7bbcaf None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:39.544744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:39.545516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:39.545797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:39.546071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:39.556115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:39.557542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:39.574266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:39.575166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:39.576122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:39.576122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:39.576122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:39.576122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:39.576122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 637/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:39.581593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.677393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46588232-2921-46d3-8dc2-16e1893115bc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:39.710535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:39.711183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:39.711467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:39.711746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:39.712462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:39.712768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:39.714109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:39.724861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 633/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:39.730244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.761607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:39.833551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b840c78-32a2-4cff-83a9-3a268b8d4017 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:39.865566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:39.866392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:39.866679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:39.866958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:39.874320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:39.875751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:00:39.889566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:39.890645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:39.891609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 638/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 09:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:39.896515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:39.952815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:39.993424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832a8a7-55b6-4ea9-ae5c-54271c91fdd1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:40.026368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:40.027060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:40.027301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:40.027577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:40.028925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:40.029236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:40.030720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1df14-90fc-478f-a097-ca02f2471925 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:40.042496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 634/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 09:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:40.048304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:40.136437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:40.145429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a1b3-8ee6-4536-af7a-6d2921d9b48e None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:40.177808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079ae23-99ae-44ca-bd6e-cd82edb41e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:40.178703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079ae23-99ae-44ca-bd6e-cd82edb41e2a None admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:40.178986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079ae23-99ae-44ca-bd6e-cd82edb41e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:40.179260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079ae23-99ae-44ca-bd6e-cd82edb41e2a None admin] PATH_INFO: `/v3/projects/538ff438321a4f52a44f39f24a097997/users/c2b5e5bb5b614905b7ff314b54bf8097/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:40.181176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079ae23-99ae-44ca-bd6e-cd82edb41e2a None admin] RBAC: Authorizing `identity:create_grant(project_id=538ff438321a4f52a44f39f24a097997, user_id=c2b5e5bb5b614905b7ff314b54bf8097, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:40.182617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079ae23-99ae-44ca-bd6e-cd82edb41e2a None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:40.194887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Fri Jun 24 09:00:40 2022] PUT /identity/v3/projects/538ff438321a4f52a44f39f24a097997/users/c2b5e5bb5b614905b7ff314b54bf8097/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:00:42.186779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf7019-daa6-4ebb-abea-250e03feef85 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:42.187275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf7019-daa6-4ebb-abea-250e03feef85 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:42.187362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf7019-daa6-4ebb-abea-250e03feef85 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:42.188712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 635/1274] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:42.193728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:42.194092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:42.194316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:42.211030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:42.212197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:42.275854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:42.299689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf7019-daa6-4ebb-abea-250e03feef85 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:42.396588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf7019-daa6-4ebb-abea-250e03feef85 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:42.413389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:42.430185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:42.430988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:42.431268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:42.431541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:42.441884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:00:42.449484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:42.450592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:42.451730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 636/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Fri Jun 24 09:00:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:42.456642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:42.534012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:42.552578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf4414-fca6-4e81-876f-b25e8905ec06 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:42.584320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:42.584969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:42.585251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:42.585526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:42.586290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:42.586599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:42.587953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:42.596186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 641/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Fri Jun 24 09:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:42.601628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:42.698163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf716d-299c-4e8e-9d64-6b829df5bf8a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:42.730036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:42.730828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:42.731110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:42.731449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:42.741429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:42.742875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:42.760619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:42.761896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:42.764133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:42.764133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:42.764133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:42.764133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:42.764133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 637/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:42.768870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:42.868091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf435bdc-a129-4453-8b16-10a6dc2db508 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:42.901342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:42.901987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:42.902295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:42.902576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:42.903828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:42.904134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:42.905488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:42.916801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 642/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:42.922551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:42.952850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:43.020011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac87af-8cb5-4473-a478-08f4a7cdbed5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:43.053141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:43.053940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:43.054242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:43.054536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:43.062597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:43.064036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:00:43.078532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:43.079596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:43.080754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 638/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:43.085408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:43.089085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:43.179705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b1ef-31c7-45d7-9766-5fd68ce4a8ce None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:43.212270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:43.212916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:43.213195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:43.213468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:43.214314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:43.214619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:43.216041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:43.232163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 643/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jun 24 09:00:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:43.237721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:43.325911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:43.337686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc775bc-46c7-4dc3-abe7-fa34666341de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:43.375519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:43.376157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:43.376444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:43.376723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:43.442106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:43.443501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:43.527677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:43.538503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Fri Jun 24 09:00:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:00:43.544762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:43.605668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:43.643293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc0ed4-b4a4-498e-b127-d0be7cac246f None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:43.676141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:43.676929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:43.677215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:43.677493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:43.687275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:43.688712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:00:43.706269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:43.707315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:43.708664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:00:43.708664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:00:43.708664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:00:43.708664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:43.708664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 644/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:43.713072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:43.813237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98fb21-0ebb-43bd-95a8-b165c46821b8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:43.844961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:43.845609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:43.845890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:43.846161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:43.846902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:43.847202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:43.848547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:43.859782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 640/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Fri Jun 24 09:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:43.865385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:43.961392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5768da-edbd-4395-a629-a7f254a4c99d None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:43.975084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:43.995245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:43.996018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:43.996298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:43.996570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:44.002975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:44.004402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:00:44.018021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:44.019121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: ERROR keystone.server.flask.application Jun 24 09:00:44.020236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 645/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Fri Jun 24 09:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:44.024924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:44.074096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:44.123012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b754b-f67c-4a19-906d-09ef3aa16a68 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:44.155206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:44.155851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:44.156136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:44.156414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:44.157199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:44.157511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:44.158958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28bd94-74bc-45c4-a4e8-a5f8f26c7891 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:44.170450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 641/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Fri Jun 24 09:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:44.176575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:44.272444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2394609-e8a7-401d-b90d-a19afdce57cc None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:44.305009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:44.305643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:44.305926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:44.306205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:44.307056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] RBAC: Adding query filter params (role.id=a5bcf8b6a0564fba816455253e926cb5, scope.project.id=538ff438321a4f52a44f39f24a097997, user.id=c2b5e5bb5b614905b7ff314b54bf8097) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:44.307368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:44.308777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc317a-36f9-4b0d-9f58-b524ad7dfdcf None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:44.314458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 646/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Fri Jun 24 09:00:44 2022] GET /identity/v3/role_assignments?user.id=c2b5e5bb5b614905b7ff314b54bf8097&scope.project.id=538ff438321a4f52a44f39f24a097997&role.id=a5bcf8b6a0564fba816455253e926cb5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:46.331676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94632-6c1b-4f85-920e-31be3507c036 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:46.332197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94632-6c1b-4f85-920e-31be3507c036 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:46.332197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d94632-6c1b-4f85-920e-31be3507c036 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:46.333508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 642/1288] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:46.338545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:46.338914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:46.339201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:46.355984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:46.357829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:46.386022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:46.422453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:46.444794 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d94632-6c1b-4f85-920e-31be3507c036 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:46.541767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d94632-6c1b-4f85-920e-31be3507c036 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:46.553228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:46.575932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:46.576715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:46.576996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:46.577269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:46.577919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:46.579322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:46.591098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:46.592302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:46.593355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 643/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 09:00:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:46.598009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:46.692476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b927b-de3f-47bf-b004-50da33da3262 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:46.724121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:46.724763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:46.725043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:46.725313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:46.726004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:46.726331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:46.727677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa544-448b-41cf-80ac-66f48eeb85d9 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:46.732914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 648/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 09:00:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:46.738351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:46.846890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d33b6-da1b-453f-8bc1-02d2f871edc3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:46.879892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:46.880546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:46.880828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:46.881105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:46.881812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:46.882117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:46.883566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28844f44-c242-46d6-9c7b-aa640c97d74b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:46.887946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 644/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 09:00:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:48.872558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37408-9966-4405-989e-fe8a4145a1f1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:48.873117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37408-9966-4405-989e-fe8a4145a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:48.873117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d37408-9966-4405-989e-fe8a4145a1f1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:48.874513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 649/1293] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:48.879531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e126-f58e-4977-8259-ca77e18fc41a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:48.879906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e126-f58e-4977-8259-ca77e18fc41a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:48.880092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e126-f58e-4977-8259-ca77e18fc41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:48.896903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-28b9e126-f58e-4977-8259-ca77e18fc41a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:48.898071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-28b9e126-f58e-4977-8259-ca77e18fc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:48.926954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:48.963132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:48.986951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37408-9966-4405-989e-fe8a4145a1f1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:49.019270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:49.086794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d37408-9966-4405-989e-fe8a4145a1f1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:49.120157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a7af2-9cf8-4f81-ad8f-c6695d585a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:49.120810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7af2-9cf8-4f81-ad8f-c6695d585a6b None admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:49.121094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7af2-9cf8-4f81-ad8f-c6695d585a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:49.121368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7af2-9cf8-4f81-ad8f-c6695d585a6b None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:49.122774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a7af2-9cf8-4f81-ad8f-c6695d585a6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:49.124079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a7af2-9cf8-4f81-ad8f-c6695d585a6b None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:49.136222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Fri Jun 24 09:00:48 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:00:51.114010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979af6-93ed-4f66-8b05-24079d5563c5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:51.114555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979af6-93ed-4f66-8b05-24079d5563c5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:51.114651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979af6-93ed-4f66-8b05-24079d5563c5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:51.115970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 646/1296] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:51.121231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:51.121668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:51.121800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:51.138538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:51.139753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:51.209167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:51.231947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979af6-93ed-4f66-8b05-24079d5563c5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:51.329179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979af6-93ed-4f66-8b05-24079d5563c5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:51.361565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:51.362370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:51.362653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:51.362929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:51.363583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:51.364930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:51.376669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:51.377912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:51.379323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 647/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 09:00:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:51.383775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:51.402290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:51.480739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc70e8-6752-4a9d-a8ae-6d2ccc50b84d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:51.513707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:51.514379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:51.514662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:51.514937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:51.515634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:51.515936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:51.517283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:51.522395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 652/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 09:00:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:51.528200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:51.558467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:51.625843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d9b76-7905-4afd-9b6d-abc6e7269a37 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:51.658013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:51.658686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:51.658971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:51.659245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:51.660028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] RBAC: Adding query filter params (interface=public, service_id=26325364a71b4bb4aa1cb90faa02dfa7, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:51.660340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:51.661680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6007f-7a93-4115-9c1f-9510d701d64b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:51.666586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 648/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Fri Jun 24 09:00:51 2022] GET /identity/v3/endpoints?service_id=26325364a71b4bb4aa1cb90faa02dfa7&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:51.672096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:51.750840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:51.771208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464103bd-4a83-40a7-b162-e616de564105 None admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:51.808970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed9314-b95e-4faa-a498-ff2225bfa531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:51.810200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9314-b95e-4faa-a498-ff2225bfa531 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:51.810510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9314-b95e-4faa-a498-ff2225bfa531 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:51.810788 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed9314-b95e-4faa-a498-ff2225bfa531 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:51.811467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed9314-b95e-4faa-a498-ff2225bfa531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:51.812836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed9314-b95e-4faa-a498-ff2225bfa531 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:51.819812 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 653/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Fri Jun 24 09:00:51 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:00:53.798201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc183-defa-49c1-b431-56e277be3f4c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:53.798766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc183-defa-49c1-b431-56e277be3f4c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:53.798766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc183-defa-49c1-b431-56e277be3f4c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:53.800147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 649/1302] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:00:53.805320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:53.805756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:53.805880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:53.822121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:00:53.823330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:00:53.887462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 654/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:00:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:00:53.910667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc183-defa-49c1-b431-56e277be3f4c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:54.001468 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:54.008819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc183-defa-49c1-b431-56e277be3f4c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:54.042053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:54.042885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:54.043171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:54.043447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:54.044711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:54.046076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:00:54.057748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:00:54.058766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jun 24 09:00:54.059977 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 650/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jun 24 09:00:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:00:54.064771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:54.138632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:54.161186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4a29b-a33e-4a0c-97d8-b075f5bcbb5f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:54.192901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:54.193539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:54.193818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:54.194090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] PATH_INFO: `/v3/services` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:54.194817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:00:54.195121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:54.196462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1755d3-8cd3-4937-84a6-4b1d6c775918 None admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:54.201945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 655/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Fri Jun 24 09:00:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:00:54.207581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:00:54.304680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007f61-aa4d-471c-bd76-5f990d1280b3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:00:54.337453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4a3d0-e73a-437d-9794-5c7965e1b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:00:54.338036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a3d0-e73a-437d-9794-5c7965e1b5e8 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:00:54.338349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a3d0-e73a-437d-9794-5c7965e1b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:00:54.338628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a3d0-e73a-437d-9794-5c7965e1b5e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:00:54.339366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4a3d0-e73a-437d-9794-5c7965e1b5e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:00:54.340741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4a3d0-e73a-437d-9794-5c7965e1b5e8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:00:54.358287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 651/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Fri Jun 24 09:00:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:01:04.198459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=30 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:04.353921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:56.588203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d992-9cb4-47e9-bd68-cd6099567f72 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:56.588789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d992-9cb4-47e9-bd68-cd6099567f72 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:56.588789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466d992-9cb4-47e9-bd68-cd6099567f72 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:56.590938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 656/1307] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:01:56.595856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c6f2-9f5a-4aae-ac58-be01fe292052 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:56.596250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c6f2-9f5a-4aae-ac58-be01fe292052 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:56.596546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c6f2-9f5a-4aae-ac58-be01fe292052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:56.679455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fa15c6f2-9f5a-4aae-ac58-be01fe292052 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:01:56.680715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fa15c6f2-9f5a-4aae-ac58-be01fe292052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:56.808806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:01:56.865764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9c05-b35b-4042-9d45-d181e098a1ea None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:56.866047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9c05-b35b-4042-9d45-d181e098a1ea None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:56.866579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9c05-b35b-4042-9d45-d181e098a1ea None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:56.867947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 657/1309] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jun 24 09:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:01:56.875458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346e5c-11ae-4a3d-a4fa-4a79d4932ea7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:56.875750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346e5c-11ae-4a3d-a4fa-4a79d4932ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:56.876082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8346e5c-11ae-4a3d-a4fa-4a79d4932ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:56.954334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f8346e5c-11ae-4a3d-a4fa-4a79d4932ea7 None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:01:56.955519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f8346e5c-11ae-4a3d-a4fa-4a79d4932ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:56.976648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:57.036451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jun 24 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:01:57.045530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9c05-b35b-4042-9d45-d181e098a1ea None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:01:57.047424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4fbe9c05-b35b-4042-9d45-d181e098a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:57.170649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9c05-b35b-4042-9d45-d181e098a1ea None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:01:57.249296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:01:57.249951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:57.250262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:57.250546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:57.252228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:57.309503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:57.369397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:01:57.371292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c223aa2-3cf5-42dc-a02f-818f610b825e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:01:57.392942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 658/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:01:59.741592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0446e1-5883-4d88-972e-e2a8c64c84c6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:59.742099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0446e1-5883-4d88-972e-e2a8c64c84c6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:59.742099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0446e1-5883-4d88-972e-e2a8c64c84c6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:59.747804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 654/1312] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:01:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:01:59.749784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f9b5-7e6a-4af3-9028-f7536d39f6ce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:59.750210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f9b5-7e6a-4af3-9028-f7536d39f6ce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:59.750377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530f9b5-7e6a-4af3-9028-f7536d39f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:59.835842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d530f9b5-7e6a-4af3-9028-f7536d39f6ce None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:01:59.837049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d530f9b5-7e6a-4af3-9028-f7536d39f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:59.948305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:01:59.986782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0446e1-5883-4d88-972e-e2a8c64c84c6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:01:59.988300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e0446e1-5883-4d88-972e-e2a8c64c84c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:00.097972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0446e1-5883-4d88-972e-e2a8c64c84c6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:00.173933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:00.176596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:00.177506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:00.178023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:00.178683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:00.180909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:00.292303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:00.293653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc841409-bb39-4de7-a559-33b7458ace57 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:00.312762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 655/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:02.647756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8bea-9d57-4720-abcf-ead9f0da5932 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:02.648286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8bea-9d57-4720-abcf-ead9f0da5932 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:02.648286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8bea-9d57-4720-abcf-ead9f0da5932 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:02.649687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 660/1315] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:02.654751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8fe35-18b4-4583-a8c7-51eaef4693d4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:02.655122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8fe35-18b4-4583-a8c7-51eaef4693d4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:02.655307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8fe35-18b4-4583-a8c7-51eaef4693d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:02.718174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eba8fe35-18b4-4583-a8c7-51eaef4693d4 None None] MFA Rules not processed for user `1b2070e8c1934cd2858f41274edb64eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:02.719389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eba8fe35-18b4-4583-a8c7-51eaef4693d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:02.771119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:02.815414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:02.854441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8bea-9d57-4720-abcf-ead9f0da5932 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:02.855998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-00ea8bea-9d57-4720-abcf-ead9f0da5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:02.865616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:02.959107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8bea-9d57-4720-abcf-ead9f0da5932 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:03.031109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:03.031759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:03.032041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:03.032317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:03.033952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:03.094170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:03.140737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:03.142154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247c6ac-3f17-497e-bdc0-e05a1aff9b51 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:03.159538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 661/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:05.735511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3693c-18f2-4ada-bea5-9658b2692a70 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:05.736062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3693c-18f2-4ada-bea5-9658b2692a70 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:05.736062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3693c-18f2-4ada-bea5-9658b2692a70 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:05.737449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 657/1318] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:05.742611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abf17-55af-4704-8cb5-21948584fc02 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:05.743006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abf17-55af-4704-8cb5-21948584fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:05.743174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abf17-55af-4704-8cb5-21948584fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:05.807253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-290abf17-55af-4704-8cb5-21948584fc02 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:05.808495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-290abf17-55af-4704-8cb5-21948584fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:05.902488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 662/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:05.957333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd20a-04cd-49bd-9415-f0552c8fdb11 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:05.957622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd20a-04cd-49bd-9415-f0552c8fdb11 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:05.957902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd20a-04cd-49bd-9415-f0552c8fdb11 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:05.959316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 658/1320] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jun 24 09:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:05.965205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2edc7-4cda-44d0-bbe6-23764bd4c560 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:05.965496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2edc7-4cda-44d0-bbe6-23764bd4c560 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:05.965776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2edc7-4cda-44d0-bbe6-23764bd4c560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:05.986896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:06.043186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f7f2edc7-4cda-44d0-bbe6-23764bd4c560 None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:06.044394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f7f2edc7-4cda-44d0-bbe6-23764bd4c560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:06.118137 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 663/1321] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jun 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:06.127531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd20a-04cd-49bd-9415-f0552c8fdb11 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:06.129051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-14bdd20a-04cd-49bd-9415-f0552c8fdb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:06.230338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd20a-04cd-49bd-9415-f0552c8fdb11 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:06.301728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:06.302334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:06.302619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:06.302895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:06.304502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:06.312867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:06.412633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:06.414055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5a614-e2ce-4455-b6f1-caacbbdbe860 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:06.431911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 659/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:09.521070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724fbea-41c2-4ff0-8016-cb621eb49327 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:09.521609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724fbea-41c2-4ff0-8016-cb621eb49327 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:09.521698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724fbea-41c2-4ff0-8016-cb621eb49327 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:09.523059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 664/1323] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:09.528211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6de1b-fde8-4fa2-8223-24fb22dd2f78 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:09.528612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6de1b-fde8-4fa2-8223-24fb22dd2f78 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:09.528764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6de1b-fde8-4fa2-8223-24fb22dd2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:09.594415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4ed6de1b-fde8-4fa2-8223-24fb22dd2f78 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:09.595599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4ed6de1b-fde8-4fa2-8223-24fb22dd2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:09.653354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:09.696415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 660/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:09.733624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724fbea-41c2-4ff0-8016-cb621eb49327 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:09.735218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e724fbea-41c2-4ff0-8016-cb621eb49327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:09.845059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724fbea-41c2-4ff0-8016-cb621eb49327 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:09.858197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:09.919521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:09.920182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:09.920473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:09.920744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:09.922415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:10.032017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:10.033455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a84a1-fe3e-40ad-8aa2-a015376f365b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:10.051635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 665/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:12.128225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271946e-4e8e-4691-8a2c-bb8e5d729fa0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:12.128773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271946e-4e8e-4691-8a2c-bb8e5d729fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:12.128773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271946e-4e8e-4691-8a2c-bb8e5d729fa0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:12.130121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 661/1326] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:12.135320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508ad2-8e8c-4862-9e51-9f533f4164b9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:12.135771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508ad2-8e8c-4862-9e51-9f533f4164b9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:12.135885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508ad2-8e8c-4862-9e51-9f533f4164b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:12.181804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:12.199929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-22508ad2-8e8c-4862-9e51-9f533f4164b9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:12.201185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-22508ad2-8e8c-4862-9e51-9f533f4164b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:12.297737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 666/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:12.332892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271946e-4e8e-4691-8a2c-bb8e5d729fa0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:12.334461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1271946e-4e8e-4691-8a2c-bb8e5d729fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:12.438879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271946e-4e8e-4691-8a2c-bb8e5d729fa0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:12.511738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:12.512390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:12.512674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:12.512949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:12.515158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:12.531629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:12.628395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:12.629825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c13bce-301e-4d7f-a61c-ac08bcb495bd service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:12.648065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 662/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:14.711941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5664ff-9505-43ac-b29a-bdc3ed922d7d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:14.712465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5664ff-9505-43ac-b29a-bdc3ed922d7d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:14.712584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5664ff-9505-43ac-b29a-bdc3ed922d7d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:14.713917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 667/1329] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:14.719781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f88b0-8dd0-4a4f-bddc-076f25547cca None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:14.720246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f88b0-8dd0-4a4f-bddc-076f25547cca None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:14.720353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f88b0-8dd0-4a4f-bddc-076f25547cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:14.783585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-de2f88b0-8dd0-4a4f-bddc-076f25547cca None None] MFA Rules not processed for user `1b2070e8c1934cd2858f41274edb64eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:14.784763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-de2f88b0-8dd0-4a4f-bddc-076f25547cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:14.850713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:14.885304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 663/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:02:14.923965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5664ff-9505-43ac-b29a-bdc3ed922d7d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:14.925691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6b5664ff-9505-43ac-b29a-bdc3ed922d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:15.034989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5664ff-9505-43ac-b29a-bdc3ed922d7d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:15.054874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:15.108898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:15.109467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:15.109754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:15.110029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:15.111753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:15.220107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:15.221540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d227258-a9e0-4724-8fd3-27a0abc0f5a2 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:15.239468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 668/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:17.544163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7534-6de3-442a-829e-f8afc09a8a00 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:17.544687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7534-6de3-442a-829e-f8afc09a8a00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:17.544687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a7534-6de3-442a-829e-f8afc09a8a00 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:17.546582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 664/1332] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:17.551843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a10bf-ce43-4f23-895c-6c71bfef6280 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:17.552243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a10bf-ce43-4f23-895c-6c71bfef6280 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:17.552418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a10bf-ce43-4f23-895c-6c71bfef6280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:17.613930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:17.616861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fa0a10bf-ce43-4f23-895c-6c71bfef6280 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:17.618651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fa0a10bf-ce43-4f23-895c-6c71bfef6280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:17.713589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 669/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:02:17.750091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a7534-6de3-442a-829e-f8afc09a8a00 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:17.751641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dc2a7534-6de3-442a-829e-f8afc09a8a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:17.854986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a7534-6de3-442a-829e-f8afc09a8a00 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:17.927109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:17.927751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:17.928033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:17.928309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:17.929940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:17.956205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:18.038621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:18.040055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd51d93-3dde-4aaf-8a89-8179dbfdfc19 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:18.059583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 665/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:20.120945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868c20-6a30-4538-ad9f-9ab7b565e1d1 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:20.121456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868c20-6a30-4538-ad9f-9ab7b565e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:20.121549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868c20-6a30-4538-ad9f-9ab7b565e1d1 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:20.122921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 670/1335] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:20.128032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f947-140c-4ca4-9600-b0b4fa2b1708 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:20.128414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f947-140c-4ca4-9600-b0b4fa2b1708 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:20.128644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f947-140c-4ca4-9600-b0b4fa2b1708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:20.191834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0201f947-140c-4ca4-9600-b0b4fa2b1708 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:20.193007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0201f947-140c-4ca4-9600-b0b4fa2b1708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:20.265947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:20.288646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 666/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:02:20.327885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868c20-6a30-4538-ad9f-9ab7b565e1d1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:20.329425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87868c20-6a30-4538-ad9f-9ab7b565e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:20.430377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868c20-6a30-4538-ad9f-9ab7b565e1d1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:20.458641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:20.502122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:20.502780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:20.503058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:20.503326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:20.504955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:20.610567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:20.612034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06b601-bc0b-4ba8-ace2-af5af72eb41e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:20.630142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 671/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:22.957056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e470e-e0b9-4efa-9abd-e6c96bd89181 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:22.957661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e470e-e0b9-4efa-9abd-e6c96bd89181 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:22.957661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e470e-e0b9-4efa-9abd-e6c96bd89181 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:22.959027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 667/1338] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:22.964166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c62be0-aff4-4e8c-b65b-bcb8d7e35514 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:22.964580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c62be0-aff4-4e8c-b65b-bcb8d7e35514 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:22.964751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c62be0-aff4-4e8c-b65b-bcb8d7e35514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:23.028721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-73c62be0-aff4-4e8c-b65b-bcb8d7e35514 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:23.029914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-73c62be0-aff4-4e8c-b65b-bcb8d7e35514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:23.038050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:23.123018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:23.159341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e470e-e0b9-4efa-9abd-e6c96bd89181 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:23.160907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f47e470e-e0b9-4efa-9abd-e6c96bd89181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:23.268777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e470e-e0b9-4efa-9abd-e6c96bd89181 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:23.340031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:23.340670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:23.340955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:23.341231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:23.342922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:23.378253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:23.449957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:23.451438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8583-02fa-48e9-b342-891931c5b136 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:23.468990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 668/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:27.521488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d517-d879-41cb-848a-e6748844885e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:27.522058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d517-d879-41cb-848a-e6748844885e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:27.522058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1d517-d879-41cb-848a-e6748844885e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:27.523551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 673/1341] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:27.528872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612c525-2556-46e9-9402-2403d2322e40 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:27.529849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612c525-2556-46e9-9402-2403d2322e40 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:27.529961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612c525-2556-46e9-9402-2403d2322e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:27.601791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b612c525-2556-46e9-9402-2403d2322e40 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:27.603012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b612c525-2556-46e9-9402-2403d2322e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:27.698564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:27.712783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 669/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:27.752477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1d517-d879-41cb-848a-e6748844885e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:27.754716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c2a1d517-d879-41cb-848a-e6748844885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:27.850265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1d517-d879-41cb-848a-e6748844885e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:27.853845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442830c2-5ddb-45c1-9662-376687dab56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:27.854521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442830c2-5ddb-45c1-9662-376687dab56e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:27.854806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442830c2-5ddb-45c1-9662-376687dab56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:27.855082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442830c2-5ddb-45c1-9662-376687dab56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:27.864480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442830c2-5ddb-45c1-9662-376687dab56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:27.865895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442830c2-5ddb-45c1-9662-376687dab56e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:27.876061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 674/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:30.500363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a046c1-7e95-44b5-a832-cbc33977eeb2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:30.500892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a046c1-7e95-44b5-a832-cbc33977eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:30.501070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a046c1-7e95-44b5-a832-cbc33977eeb2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:30.502490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 670/1344] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:30.507858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccb81e-9d12-4f36-ad19-fc7d501c5914 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:30.508273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccb81e-9d12-4f36-ad19-fc7d501c5914 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:30.508442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccb81e-9d12-4f36-ad19-fc7d501c5914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:30.536269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-84ccb81e-9d12-4f36-ad19-fc7d501c5914 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:30.537461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-84ccb81e-9d12-4f36-ad19-fc7d501c5914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:30.566943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:30.619848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:30.658088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a046c1-7e95-44b5-a832-cbc33977eeb2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:30.669171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a046c1-7e95-44b5-a832-cbc33977eeb2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:30.673433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe58f-036c-429b-b4d4-5f2b47512c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:30.674083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe58f-036c-429b-b4d4-5f2b47512c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:30.674401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe58f-036c-429b-b4d4-5f2b47512c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:30.674676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe58f-036c-429b-b4d4-5f2b47512c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:30.684365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe58f-036c-429b-b4d4-5f2b47512c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:30.685800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe58f-036c-429b-b4d4-5f2b47512c18 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:30.696071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:34.697312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1753-733a-4655-891d-94c291c8316a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:34.697836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1753-733a-4655-891d-94c291c8316a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:34.697836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1753-733a-4655-891d-94c291c8316a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:34.699204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 676/1347] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:34.705052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116efe0-b1a9-4d57-8aa0-d76002da1b0e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:34.705475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116efe0-b1a9-4d57-8aa0-d76002da1b0e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:34.705588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116efe0-b1a9-4d57-8aa0-d76002da1b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:34.723174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7116efe0-b1a9-4d57-8aa0-d76002da1b0e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:34.724368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7116efe0-b1a9-4d57-8aa0-d76002da1b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:34.732404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 672/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:34.771540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c1753-733a-4655-891d-94c291c8316a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:34.774277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7c8c1753-733a-4655-891d-94c291c8316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:34.788417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c1753-733a-4655-891d-94c291c8316a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:34.792755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07937124-d9a5-4bac-a72b-f00ee6b21587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:34.793506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07937124-d9a5-4bac-a72b-f00ee6b21587 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:34.793906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07937124-d9a5-4bac-a72b-f00ee6b21587 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:34.794322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07937124-d9a5-4bac-a72b-f00ee6b21587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:34.803844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07937124-d9a5-4bac-a72b-f00ee6b21587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:34.805296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07937124-d9a5-4bac-a72b-f00ee6b21587 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:34.814696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 677/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:39.849004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7a098-9821-44fa-b3e6-8014cf0a2c7d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:39.849430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7a098-9821-44fa-b3e6-8014cf0a2c7d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:39.849624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7a098-9821-44fa-b3e6-8014cf0a2c7d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:39.850961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 673/1350] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:39.855984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070c3d9-fce6-4bee-a4b1-365986d90d9d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:39.856380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070c3d9-fce6-4bee-a4b1-365986d90d9d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:39.856535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070c3d9-fce6-4bee-a4b1-365986d90d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:39.951354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d070c3d9-fce6-4bee-a4b1-365986d90d9d None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:39.952862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d070c3d9-fce6-4bee-a4b1-365986d90d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:40.081819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 678/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:02:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:44.337168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58f664-5b6c-462a-aec2-71c705242655 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:44.338053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58f664-5b6c-462a-aec2-71c705242655 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:44.338482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58f664-5b6c-462a-aec2-71c705242655 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:44.339933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 674/1352] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:44.345073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646ef30-8d19-4069-aa8c-751e551a8701 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:44.345487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646ef30-8d19-4069-aa8c-751e551a8701 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:44.345664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646ef30-8d19-4069-aa8c-751e551a8701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:44.364259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b646ef30-8d19-4069-aa8c-751e551a8701 None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:44.365442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b646ef30-8d19-4069-aa8c-751e551a8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:44.374928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 679/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:44.718675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=13 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:45.828442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdd9f0-1dad-4abc-9284-d715b03655e2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:45.829054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdd9f0-1dad-4abc-9284-d715b03655e2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:45.829054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdd9f0-1dad-4abc-9284-d715b03655e2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:45.830384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 675/1354] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:45.835396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997e8f-767d-44af-827f-806877408df6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:45.835808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997e8f-767d-44af-827f-806877408df6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:45.836078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32997e8f-767d-44af-827f-806877408df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:45.854247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-32997e8f-767d-44af-827f-806877408df6 None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:45.855444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-32997e8f-767d-44af-827f-806877408df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:45.863891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 680/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:02:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:49.430559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75111-99b5-4b01-9b30-6fcb830da026 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:49.431767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75111-99b5-4b01-9b30-6fcb830da026 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:49.432246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75111-99b5-4b01-9b30-6fcb830da026 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:49.434020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 676/1356] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:49.439748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859a34-9e29-47b6-9444-b70af15baaf8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:49.440204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859a34-9e29-47b6-9444-b70af15baaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:49.440319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad859a34-9e29-47b6-9444-b70af15baaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:49.459732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ad859a34-9e29-47b6-9444-b70af15baaf8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:49.460922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad859a34-9e29-47b6-9444-b70af15baaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:49.470053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 681/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:49.526455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2615b7c-1e38-4305-b6ef-6c967f199a69 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:49.527052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2615b7c-1e38-4305-b6ef-6c967f199a69 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:49.527493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2615b7c-1e38-4305-b6ef-6c967f199a69 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:49.529653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 677/1358] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 09:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:49.539604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241a463-3368-4bd4-87c8-eceaf21e440c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:49.540393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241a463-3368-4bd4-87c8-eceaf21e440c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:49.540824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241a463-3368-4bd4-87c8-eceaf21e440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:49.586127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:49.596682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5241a463-3368-4bd4-87c8-eceaf21e440c None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:49.598180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5241a463-3368-4bd4-87c8-eceaf21e440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:49.687987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 682/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 09:02:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:49.695630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2615b7c-1e38-4305-b6ef-6c967f199a69 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:49.710707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2615b7c-1e38-4305-b6ef-6c967f199a69 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:49.716969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b9c7e-9f32-4025-a724-0dc1b369116c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:49.717746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b9c7e-9f32-4025-a724-0dc1b369116c service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:49.718120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b9c7e-9f32-4025-a724-0dc1b369116c service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:49.718513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b9c7e-9f32-4025-a724-0dc1b369116c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:49.727368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b9c7e-9f32-4025-a724-0dc1b369116c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:49.729061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b9c7e-9f32-4025-a724-0dc1b369116c service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:49.739106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 678/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:51.984559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbd423-28c1-415d-9169-876151fdf698 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:51.985097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbd423-28c1-415d-9169-876151fdf698 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:51.985179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbd423-28c1-415d-9169-876151fdf698 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:51.986838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 683/1361] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:51.992058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff9370-963b-4e86-8f51-5d3932af6f68 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:51.992468 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff9370-963b-4e86-8f51-5d3932af6f68 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:51.992614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff9370-963b-4e86-8f51-5d3932af6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:52.011875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5eff9370-963b-4e86-8f51-5d3932af6f68 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:52.013241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5eff9370-963b-4e86-8f51-5d3932af6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:52.025040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 679/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:52.070887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbd423-28c1-415d-9169-876151fdf698 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:52.085427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbd423-28c1-415d-9169-876151fdf698 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:52.090883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c05d39-8fd4-4973-86a2-f47926f69d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:52.092078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c05d39-8fd4-4973-86a2-f47926f69d93 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:52.092361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c05d39-8fd4-4973-86a2-f47926f69d93 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:52.092635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c05d39-8fd4-4973-86a2-f47926f69d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:52.101477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c05d39-8fd4-4973-86a2-f47926f69d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:52.103175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c05d39-8fd4-4973-86a2-f47926f69d93 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:52.113714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 684/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:54.459426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc7a5-bf06-4b3b-af35-0b67d85dcc3f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:54.460003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc7a5-bf06-4b3b-af35-0b67d85dcc3f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:54.460003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc7a5-bf06-4b3b-af35-0b67d85dcc3f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:54.461390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 680/1364] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:54.466789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69053-e820-4205-bee5-74c62d87dfa3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:54.467209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69053-e820-4205-bee5-74c62d87dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:54.467342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69053-e820-4205-bee5-74c62d87dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:54.485108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b2a69053-e820-4205-bee5-74c62d87dfa3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:54.486507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2a69053-e820-4205-bee5-74c62d87dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:54.498313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 685/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:02:54.549469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1995a-1c77-4a16-b8df-d40b461f5bfe None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:54.549752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1995a-1c77-4a16-b8df-d40b461f5bfe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:54.550028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1995a-1c77-4a16-b8df-d40b461f5bfe None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:54.551459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 681/1366] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 09:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:54.556697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778b77-ade2-4f6c-9eea-6062072ff13b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:54.557016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778b77-ade2-4f6c-9eea-6062072ff13b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:54.557303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f778b77-ade2-4f6c-9eea-6062072ff13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:54.576534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7f778b77-ade2-4f6c-9eea-6062072ff13b None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:54.577755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7f778b77-ade2-4f6c-9eea-6062072ff13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:54.586920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 686/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:54.594697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1995a-1c77-4a16-b8df-d40b461f5bfe None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:54.608577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1995a-1c77-4a16-b8df-d40b461f5bfe None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:54.613895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af990092-f063-45c4-bc33-85e99b9527f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:54.614561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990092-f063-45c4-bc33-85e99b9527f9 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:54.614843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990092-f063-45c4-bc33-85e99b9527f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:54.615113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af990092-f063-45c4-bc33-85e99b9527f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:54.623853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af990092-f063-45c4-bc33-85e99b9527f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:54.625401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af990092-f063-45c4-bc33-85e99b9527f9 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:54.634686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 682/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:56.734694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14831bf7-2b29-427e-be6f-f1a63d95932a None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:56.735246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14831bf7-2b29-427e-be6f-f1a63d95932a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:56.735246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14831bf7-2b29-427e-be6f-f1a63d95932a None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:56.736645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 687/1369] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:56.741911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46dde3-daf4-4435-8363-31253f4b8f7d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:56.742710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46dde3-daf4-4435-8363-31253f4b8f7d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:56.743155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46dde3-daf4-4435-8363-31253f4b8f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:56.761334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ea46dde3-daf4-4435-8363-31253f4b8f7d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:56.762575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea46dde3-daf4-4435-8363-31253f4b8f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:56.772918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 683/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:56.821283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14831bf7-2b29-427e-be6f-f1a63d95932a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:56.837152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14831bf7-2b29-427e-be6f-f1a63d95932a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:56.844132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385523f-9046-41bc-804e-d075864af69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:56.844911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385523f-9046-41bc-804e-d075864af69c service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:56.845274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385523f-9046-41bc-804e-d075864af69c service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:56.845628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385523f-9046-41bc-804e-d075864af69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:56.855735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385523f-9046-41bc-804e-d075864af69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:56.857963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385523f-9046-41bc-804e-d075864af69c service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:56.868603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 688/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:57.508359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb330-8104-4d22-aa97-0afdd966164c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:57.508650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb330-8104-4d22-aa97-0afdd966164c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:57.509196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb330-8104-4d22-aa97-0afdd966164c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:57.510620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 684/1372] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:57.515881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98e0a-d1b9-4850-9a3e-e4828555ced7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:57.516175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98e0a-d1b9-4850-9a3e-e4828555ced7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:57.516643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98e0a-d1b9-4850-9a3e-e4828555ced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:57.534682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-39e98e0a-d1b9-4850-9a3e-e4828555ced7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:57.535867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-39e98e0a-d1b9-4850-9a3e-e4828555ced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:57.543879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 689/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:57.884486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fae81d-997f-48b8-8c14-a9bca32fa55f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:57.884486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fae81d-997f-48b8-8c14-a9bca32fa55f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:57.884486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fae81d-997f-48b8-8c14-a9bca32fa55f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:57.887310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 685/1374] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jun 24 09:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:57.891171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120341-8615-4577-a250-dc706720a9b2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:57.891655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120341-8615-4577-a250-dc706720a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:57.891806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71120341-8615-4577-a250-dc706720a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:57.941609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-71120341-8615-4577-a250-dc706720a9b2 None None] MFA Rules not processed for user `78768c5fb13646dcad006e323df270a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:57.942841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-71120341-8615-4577-a250-dc706720a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:58.010184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 690/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jun 24 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:58.021985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fae81d-997f-48b8-8c14-a9bca32fa55f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:58.038520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fae81d-997f-48b8-8c14-a9bca32fa55f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:58.043075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0becc1-d6ab-4423-aa88-189040285e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:58.043730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0becc1-d6ab-4423-aa88-189040285e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:58.044017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0becc1-d6ab-4423-aa88-189040285e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:58.044929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0becc1-d6ab-4423-aa88-189040285e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:58.054436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0becc1-d6ab-4423-aa88-189040285e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:58.056097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0becc1-d6ab-4423-aa88-189040285e7f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:58.066566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 686/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:02:58.964307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5f92-9b1c-41b2-a0a1-9e0ff558eac6 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:58.964835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5f92-9b1c-41b2-a0a1-9e0ff558eac6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:58.964927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5f92-9b1c-41b2-a0a1-9e0ff558eac6 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:58.966822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 691/1377] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:02:58.972364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6665dc-a07a-43e7-801f-438e70017fdb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:58.972795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6665dc-a07a-43e7-801f-438e70017fdb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:58.972963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6665dc-a07a-43e7-801f-438e70017fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:58.990713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4c6665dc-a07a-43e7-801f-438e70017fdb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:02:58.991880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4c6665dc-a07a-43e7-801f-438e70017fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:59.000153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 687/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:02:59.045074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5f92-9b1c-41b2-a0a1-9e0ff558eac6 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:59.059370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5f92-9b1c-41b2-a0a1-9e0ff558eac6 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:59.064827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4820-185c-460f-912d-ad7431ae5355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:59.065462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4820-185c-460f-912d-ad7431ae5355 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:59.065748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4820-185c-460f-912d-ad7431ae5355 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:59.066026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4820-185c-460f-912d-ad7431ae5355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:59.074384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4820-185c-460f-912d-ad7431ae5355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:59.075981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4820-185c-460f-912d-ad7431ae5355 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:59.080808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:59.088453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 692/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:01.139010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5102-9982-4f12-916a-3b4cfb82f1f4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:01.139486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5102-9982-4f12-916a-3b4cfb82f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:01.139584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5102-9982-4f12-916a-3b4cfb82f1f4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:01.141015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 688/1380] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:01.146421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620883-b906-450d-b502-2c01c5dfb07d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:01.146829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620883-b906-450d-b502-2c01c5dfb07d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:01.147120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27620883-b906-450d-b502-2c01c5dfb07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:01.164745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-27620883-b906-450d-b502-2c01c5dfb07d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:01.165931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-27620883-b906-450d-b502-2c01c5dfb07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:01.173786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 693/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:01.218866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5102-9982-4f12-916a-3b4cfb82f1f4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:01.232827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5102-9982-4f12-916a-3b4cfb82f1f4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:01.238739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab893d-b224-4dbb-81d2-5896b0894528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:01.239374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab893d-b224-4dbb-81d2-5896b0894528 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:01.239648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab893d-b224-4dbb-81d2-5896b0894528 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:01.240105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab893d-b224-4dbb-81d2-5896b0894528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:01.249921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab893d-b224-4dbb-81d2-5896b0894528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:01.251465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab893d-b224-4dbb-81d2-5896b0894528 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:01.260801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 689/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:03.353040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a29a1-aed1-477b-bb94-e727638a9b8d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:03.353580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a29a1-aed1-477b-bb94-e727638a9b8d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:03.353580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a29a1-aed1-477b-bb94-e727638a9b8d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:03.355010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 694/1383] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:03.360739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ef4f-36ef-4fee-80ab-d4fe55555c48 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:03.361160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ef4f-36ef-4fee-80ab-d4fe55555c48 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:03.361290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553ef4f-36ef-4fee-80ab-d4fe55555c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:03.379406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9553ef4f-36ef-4fee-80ab-d4fe55555c48 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:03.380592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9553ef4f-36ef-4fee-80ab-d4fe55555c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:03.388681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 690/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:03.430781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a29a1-aed1-477b-bb94-e727638a9b8d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:03.445258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a29a1-aed1-477b-bb94-e727638a9b8d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:03.450772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def660dd-4f80-4618-9a7a-76ef4ea3f0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:03.451418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def660dd-4f80-4618-9a7a-76ef4ea3f0e6 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:03.451704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def660dd-4f80-4618-9a7a-76ef4ea3f0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:03.451977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def660dd-4f80-4618-9a7a-76ef4ea3f0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:03.460728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def660dd-4f80-4618-9a7a-76ef4ea3f0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:03.462349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def660dd-4f80-4618-9a7a-76ef4ea3f0e6 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:03.473002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 695/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:05.510591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35f0b-0417-4cfd-b31f-a34b43f504f2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:05.511111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35f0b-0417-4cfd-b31f-a34b43f504f2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:05.511230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35f0b-0417-4cfd-b31f-a34b43f504f2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:05.512983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 691/1386] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:05.519142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48c73-3ff5-4c5b-8500-e4c9d4095b08 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:05.519599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48c73-3ff5-4c5b-8500-e4c9d4095b08 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:05.519698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc48c73-3ff5-4c5b-8500-e4c9d4095b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:05.537985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2dc48c73-3ff5-4c5b-8500-e4c9d4095b08 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:05.539291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2dc48c73-3ff5-4c5b-8500-e4c9d4095b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:05.548031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:05.593081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35f0b-0417-4cfd-b31f-a34b43f504f2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:05.608425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35f0b-0417-4cfd-b31f-a34b43f504f2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:05.613962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d4fca-7293-40ad-bbcd-2c83c7cde5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:05.614646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d4fca-7293-40ad-bbcd-2c83c7cde5fb service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:05.614958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d4fca-7293-40ad-bbcd-2c83c7cde5fb service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:05.615234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d4fca-7293-40ad-bbcd-2c83c7cde5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:05.624001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d4fca-7293-40ad-bbcd-2c83c7cde5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:05.625580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d4fca-7293-40ad-bbcd-2c83c7cde5fb service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:05.635328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 692/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:07.785561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9fb5f-ed72-4798-acc6-c7c5b46e15fb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:07.786140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9fb5f-ed72-4798-acc6-c7c5b46e15fb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:07.786393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9fb5f-ed72-4798-acc6-c7c5b46e15fb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:07.788580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 697/1389] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:07.794020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc0872-2581-48f0-8704-7f96faf713b8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:07.794683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc0872-2581-48f0-8704-7f96faf713b8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:07.794683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc0872-2581-48f0-8704-7f96faf713b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:07.813662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1edc0872-2581-48f0-8704-7f96faf713b8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:07.814930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1edc0872-2581-48f0-8704-7f96faf713b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:07.826159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:07.875971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9fb5f-ed72-4798-acc6-c7c5b46e15fb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:07.897159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9fb5f-ed72-4798-acc6-c7c5b46e15fb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:07.904986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16378d-1b8b-4b84-8ff7-d4eabc69929e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:07.905864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16378d-1b8b-4b84-8ff7-d4eabc69929e service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:07.906416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16378d-1b8b-4b84-8ff7-d4eabc69929e service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:07.906808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16378d-1b8b-4b84-8ff7-d4eabc69929e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:07.918955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16378d-1b8b-4b84-8ff7-d4eabc69929e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:07.920679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16378d-1b8b-4b84-8ff7-d4eabc69929e service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:07.930971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 698/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:10.582032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce40fc-33e1-4eaf-a310-b171f6654338 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:10.582615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce40fc-33e1-4eaf-a310-b171f6654338 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:10.582714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce40fc-33e1-4eaf-a310-b171f6654338 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:10.584142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 694/1392] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:03:10.591672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a76b3-9549-4f47-91e1-f9514f419c66 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:10.592127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a76b3-9549-4f47-91e1-f9514f419c66 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:10.592541 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a76b3-9549-4f47-91e1-f9514f419c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:10.615373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a55a76b3-9549-4f47-91e1-f9514f419c66 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:10.617002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a55a76b3-9549-4f47-91e1-f9514f419c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:10.627783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 699/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:10.682371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce40fc-33e1-4eaf-a310-b171f6654338 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:10.698796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce40fc-33e1-4eaf-a310-b171f6654338 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:10.705546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155474-a5b0-4ce5-b7b0-c4248488d1fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:10.706293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155474-a5b0-4ce5-b7b0-c4248488d1fe service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:10.706623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155474-a5b0-4ce5-b7b0-c4248488d1fe service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:10.706989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155474-a5b0-4ce5-b7b0-c4248488d1fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:10.717334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155474-a5b0-4ce5-b7b0-c4248488d1fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:10.719244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155474-a5b0-4ce5-b7b0-c4248488d1fe service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:10.730542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 695/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:13.010211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f7e4-aa24-43e4-ae1f-408aa3daadbe None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:13.010701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f7e4-aa24-43e4-ae1f-408aa3daadbe None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:13.010803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f7e4-aa24-43e4-ae1f-408aa3daadbe None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:13.012151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 700/1395] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:13.019373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789617b5-515f-486e-bf33-ace32ac7e13c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:13.019804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789617b5-515f-486e-bf33-ace32ac7e13c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:13.019942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789617b5-515f-486e-bf33-ace32ac7e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:13.037734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-789617b5-515f-486e-bf33-ace32ac7e13c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:13.038971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-789617b5-515f-486e-bf33-ace32ac7e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:13.047511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 696/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:13.091843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f7e4-aa24-43e4-ae1f-408aa3daadbe None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:13.106398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f7e4-aa24-43e4-ae1f-408aa3daadbe None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:13.112538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fd18c-47bf-4549-ac8f-287847da64a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:13.113170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd18c-47bf-4549-ac8f-287847da64a4 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:13.113456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd18c-47bf-4549-ac8f-287847da64a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:13.113743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fd18c-47bf-4549-ac8f-287847da64a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:13.122350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd18c-47bf-4549-ac8f-287847da64a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:13.123921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fd18c-47bf-4549-ac8f-287847da64a4 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:13.133428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 701/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:14.107462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b080-cc5b-4aa6-8999-981aaa0408ab None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:14.108017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b080-cc5b-4aa6-8999-981aaa0408ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:14.108017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b080-cc5b-4aa6-8999-981aaa0408ab None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:14.109406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 697/1398] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:14.114559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428fe9-39b9-4737-8f3b-0ad9e56062f8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:14.114987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428fe9-39b9-4737-8f3b-0ad9e56062f8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:14.115123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b428fe9-39b9-4737-8f3b-0ad9e56062f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:14.133183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5b428fe9-39b9-4737-8f3b-0ad9e56062f8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:14.134376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5b428fe9-39b9-4737-8f3b-0ad9e56062f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:14.142720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 702/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:14.197633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154a16-b99d-4ae7-a4bc-1e6cd3834e36 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:14.197923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154a16-b99d-4ae7-a4bc-1e6cd3834e36 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:14.198198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7154a16-b99d-4ae7-a4bc-1e6cd3834e36 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:14.199587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 698/1400] 10.222.0.16 () {54 vars in 962 bytes} [Fri Jun 24 09:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:14.205391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f500cc-8dcf-4ee1-a13b-8e20f05183fb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:14.205681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f500cc-8dcf-4ee1-a13b-8e20f05183fb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:14.205956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f500cc-8dcf-4ee1-a13b-8e20f05183fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:14.255572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-60f500cc-8dcf-4ee1-a13b-8e20f05183fb None None] MFA Rules not processed for user `0713044ffd0247fe8a983d3d1ee15a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:14.256963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-60f500cc-8dcf-4ee1-a13b-8e20f05183fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:14.318652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 703/1401] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Jun 24 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:14.326368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7154a16-b99d-4ae7-a4bc-1e6cd3834e36 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:14.336973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7154a16-b99d-4ae7-a4bc-1e6cd3834e36 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:14.340481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd98c06-3a29-4580-935b-084a4ab77dfe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:14.341143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98c06-3a29-4580-935b-084a4ab77dfe service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:14.341434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98c06-3a29-4580-935b-084a4ab77dfe service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:14.341718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd98c06-3a29-4580-935b-084a4ab77dfe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:14.350669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd98c06-3a29-4580-935b-084a4ab77dfe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:14.352084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd98c06-3a29-4580-935b-084a4ab77dfe service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:14.362006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 699/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:15.080470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572020e-0631-4238-a040-9cdf0cd56fc7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.080775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572020e-0631-4238-a040-9cdf0cd56fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.081056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572020e-0631-4238-a040-9cdf0cd56fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.127742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9572020e-0631-4238-a040-9cdf0cd56fc7 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:15.128971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9572020e-0631-4238-a040-9cdf0cd56fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:15.169676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:03:15.194015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 704/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:03:15.203160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3700dad-fc07-415b-9b83-f40856d2cf0d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.203160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3700dad-fc07-415b-9b83-f40856d2cf0d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.203634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3700dad-fc07-415b-9b83-f40856d2cf0d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.204698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 700/1404] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:15.209901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6c8f-428a-4887-8004-1085d17bf3ba None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.210190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6c8f-428a-4887-8004-1085d17bf3ba None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.210508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6c8f-428a-4887-8004-1085d17bf3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.228673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-184d6c8f-428a-4887-8004-1085d17bf3ba None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:15.229908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-184d6c8f-428a-4887-8004-1085d17bf3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:15.238919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 705/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:15.240885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d46d-cb33-4698-96ee-4f1b506f83c4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.241176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d46d-cb33-4698-96ee-4f1b506f83c4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.241459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36d46d-cb33-4698-96ee-4f1b506f83c4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.242878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 701/1406] 10.222.0.16 () {54 vars in 942 bytes} [Fri Jun 24 09:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:03:15.250418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebd46d-a638-4f85-a089-4c799ba4cac8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.250651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebd46d-a638-4f85-a089-4c799ba4cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.250931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebd46d-a638-4f85-a089-4c799ba4cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.283099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36d46d-cb33-4698-96ee-4f1b506f83c4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:15.291168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=61 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:03:15.298613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36d46d-cb33-4698-96ee-4f1b506f83c4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:15.301912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-78ebd46d-a638-4f85-a089-4c799ba4cac8 None None] MFA Rules not processed for user `aef646744cb34d9eb6068cb54a31315e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:15.303136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-78ebd46d-a638-4f85-a089-4c799ba4cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:15.304063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:15.304702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.304985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.305263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.315040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:15.317165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:15.327642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 702/1407] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:03:15.377723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 706/1408] 10.222.0.16 () {58 vars in 1039 bytes} [Fri Jun 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:03:15.389201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:15.400621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3075c-704d-4f66-bc29-1dc2c3cd20a8 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:15.406583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade14dd-581a-4209-bbe9-c0f837b5ec4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:15.407354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade14dd-581a-4209-bbe9-c0f837b5ec4e service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:15.407715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade14dd-581a-4209-bbe9-c0f837b5ec4e service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:15.408067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade14dd-581a-4209-bbe9-c0f837b5ec4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:15.417755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade14dd-581a-4209-bbe9-c0f837b5ec4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:15.420295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade14dd-581a-4209-bbe9-c0f837b5ec4e service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:15.430418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 703/1409] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:03:25.374607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=56 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:03:25.426645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=11 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:03:37.292816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb79b-470b-4d96-bb54-fc723f612b58 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:37.293339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb79b-470b-4d96-bb54-fc723f612b58 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:37.293339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfb79b-470b-4d96-bb54-fc723f612b58 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:37.295373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 707/1410] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jun 24 09:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:37.300508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c28f6-644a-47a7-8194-491970cc01a9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:37.300943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c28f6-644a-47a7-8194-491970cc01a9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:37.301092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c28f6-644a-47a7-8194-491970cc01a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:37.318743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-767c28f6-644a-47a7-8194-491970cc01a9 None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:37.319990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-767c28f6-644a-47a7-8194-491970cc01a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:37.328449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 704/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jun 24 09:03:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:37.342650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad541a3b-7376-4406-ae4f-f14afc063b55 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:37.342943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad541a3b-7376-4406-ae4f-f14afc063b55 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:37.343223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad541a3b-7376-4406-ae4f-f14afc063b55 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:37.344560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 708/1412] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jun 24 09:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:37.349247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c44271-60ef-46a4-ae3f-762c14f86465 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:37.349538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c44271-60ef-46a4-ae3f-762c14f86465 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:37.349846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c44271-60ef-46a4-ae3f-762c14f86465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:37.367947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-88c44271-60ef-46a4-ae3f-762c14f86465 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:37.369127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-88c44271-60ef-46a4-ae3f-762c14f86465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:37.378563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 705/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jun 24 09:03:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:39.839725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eea90-dc0b-4eb4-98f0-0285b8c65e9d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:39.840284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eea90-dc0b-4eb4-98f0-0285b8c65e9d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:39.840284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eea90-dc0b-4eb4-98f0-0285b8c65e9d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:39.842174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:39.847271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd18b-a133-4470-9445-6950c0a47890 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:39.847648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd18b-a133-4470-9445-6950c0a47890 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:39.847829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd18b-a133-4470-9445-6950c0a47890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:39.864915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-13cbd18b-a133-4470-9445-6950c0a47890 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:39.866082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-13cbd18b-a133-4470-9445-6950c0a47890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:39.873932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:39.917992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eea90-dc0b-4eb4-98f0-0285b8c65e9d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:39.933774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eea90-dc0b-4eb4-98f0-0285b8c65e9d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:39.939514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adeb9d-10a6-4659-b994-ac2365a0f091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:39.940147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeb9d-10a6-4659-b994-ac2365a0f091 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:39.940430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeb9d-10a6-4659-b994-ac2365a0f091 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:39.940703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeb9d-10a6-4659-b994-ac2365a0f091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:39.948930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeb9d-10a6-4659-b994-ac2365a0f091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:39.951069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeb9d-10a6-4659-b994-ac2365a0f091 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:39.960368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 710/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:40.846138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dfe8d-45eb-4f89-958a-82d1e14f3fc5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:40.846455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dfe8d-45eb-4f89-958a-82d1e14f3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:40.846737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dfe8d-45eb-4f89-958a-82d1e14f3fc5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:40.848129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:40.852947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6089f90-be10-4eb4-86d2-6c12973bf04d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:40.853384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6089f90-be10-4eb4-86d2-6c12973bf04d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:40.853498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6089f90-be10-4eb4-86d2-6c12973bf04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:40.872134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d6089f90-be10-4eb4-86d2-6c12973bf04d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:40.873327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d6089f90-be10-4eb4-86d2-6c12973bf04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:40.881239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:41.031632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dfe8d-45eb-4f89-958a-82d1e14f3fc5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:41.046333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dfe8d-45eb-4f89-958a-82d1e14f3fc5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:41.051681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd32f6-68b4-439d-968f-f8feec27fbdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:41.052309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd32f6-68b4-439d-968f-f8feec27fbdf service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:41.052592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd32f6-68b4-439d-968f-f8feec27fbdf service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:41.052868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd32f6-68b4-439d-968f-f8feec27fbdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:41.060919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd32f6-68b4-439d-968f-f8feec27fbdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:41.062510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd32f6-68b4-439d-968f-f8feec27fbdf service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:41.071701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 708/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:41.947337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007980-b6ab-4736-9411-fbdabc7c6cef None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:41.947915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007980-b6ab-4736-9411-fbdabc7c6cef None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:41.948010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007980-b6ab-4736-9411-fbdabc7c6cef None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:41.949306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:41.954896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53872-150e-477f-9d09-2ac8caa069b3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:41.955334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53872-150e-477f-9d09-2ac8caa069b3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:41.955445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f53872-150e-477f-9d09-2ac8caa069b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:41.973131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b0f53872-150e-477f-9d09-2ac8caa069b3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:41.974366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b0f53872-150e-477f-9d09-2ac8caa069b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:41.982775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:42.129995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a007980-b6ab-4736-9411-fbdabc7c6cef None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:42.144715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a007980-b6ab-4736-9411-fbdabc7c6cef None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:42.150190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3c81b-facf-48cf-9f81-f4d1af472892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:42.150846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c81b-facf-48cf-9f81-f4d1af472892 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:42.151131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c81b-facf-48cf-9f81-f4d1af472892 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:42.151415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c81b-facf-48cf-9f81-f4d1af472892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:42.160087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3c81b-facf-48cf-9f81-f4d1af472892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:42.161655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3c81b-facf-48cf-9f81-f4d1af472892 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:42.171018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 713/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:43.025022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5ebda-38bb-42f5-8f7e-908e81577799 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:43.025481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5ebda-38bb-42f5-8f7e-908e81577799 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:43.025594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5ebda-38bb-42f5-8f7e-908e81577799 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:43.027018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:43.031953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4745aa-88ca-43fe-acf6-69e5c06c275b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:43.032343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4745aa-88ca-43fe-acf6-69e5c06c275b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:43.032506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4745aa-88ca-43fe-acf6-69e5c06c275b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:43.050598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-da4745aa-88ca-43fe-acf6-69e5c06c275b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:43.051771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-da4745aa-88ca-43fe-acf6-69e5c06c275b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:43.060190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:43.213780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5ebda-38bb-42f5-8f7e-908e81577799 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:43.228525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5ebda-38bb-42f5-8f7e-908e81577799 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:43.234574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632a36e-bc5d-45fb-93fd-0b067747d33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:43.235203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632a36e-bc5d-45fb-93fd-0b067747d33e service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:43.235487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632a36e-bc5d-45fb-93fd-0b067747d33e service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:43.235766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632a36e-bc5d-45fb-93fd-0b067747d33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:43.243730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632a36e-bc5d-45fb-93fd-0b067747d33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:43.245284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632a36e-bc5d-45fb-93fd-0b067747d33e service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:43.254845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 711/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:44.106909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541afb4-e15a-4e83-9fe9-52d877b72b7f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:44.107478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541afb4-e15a-4e83-9fe9-52d877b72b7f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:44.107478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541afb4-e15a-4e83-9fe9-52d877b72b7f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:44.108840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:44.113653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1add-118f-4863-951b-62175eeccb65 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:44.114041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1add-118f-4863-951b-62175eeccb65 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:44.114239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba1add-118f-4863-951b-62175eeccb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:44.133182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c4ba1add-118f-4863-951b-62175eeccb65 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:44.134420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c4ba1add-118f-4863-951b-62175eeccb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:44.142800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:44.293056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541afb4-e15a-4e83-9fe9-52d877b72b7f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:44.307782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541afb4-e15a-4e83-9fe9-52d877b72b7f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:44.313796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f4e7-b28d-4e75-826e-baa58d2434fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:44.314462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f4e7-b28d-4e75-826e-baa58d2434fc service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:44.314750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f4e7-b28d-4e75-826e-baa58d2434fc service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:44.315031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f4e7-b28d-4e75-826e-baa58d2434fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:44.323104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f4e7-b28d-4e75-826e-baa58d2434fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:44.324681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f4e7-b28d-4e75-826e-baa58d2434fc service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:44.334019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 716/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:45.136535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b160b-8239-4dde-8725-7e31fc1c948c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:45.137561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b160b-8239-4dde-8725-7e31fc1c948c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:45.137656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b160b-8239-4dde-8725-7e31fc1c948c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:45.139108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:45.144143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd61bd-8392-43b6-a953-bf9a612931a2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:45.144584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd61bd-8392-43b6-a953-bf9a612931a2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:45.144706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd61bd-8392-43b6-a953-bf9a612931a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:45.164228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-58cd61bd-8392-43b6-a953-bf9a612931a2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:45.165412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-58cd61bd-8392-43b6-a953-bf9a612931a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:45.173195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:45.322598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b160b-8239-4dde-8725-7e31fc1c948c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:45.337138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b160b-8239-4dde-8725-7e31fc1c948c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:45.343174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962958e2-26f4-4221-9b3b-36d92d142770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:45.343954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962958e2-26f4-4221-9b3b-36d92d142770 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:45.344235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962958e2-26f4-4221-9b3b-36d92d142770 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:45.344510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962958e2-26f4-4221-9b3b-36d92d142770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:45.352552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962958e2-26f4-4221-9b3b-36d92d142770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:45.354153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962958e2-26f4-4221-9b3b-36d92d142770 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:45.363406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 714/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:46.175407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e2b9-2b00-4e73-8d51-6d064e38e595 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:46.175970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e2b9-2b00-4e73-8d51-6d064e38e595 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:46.175970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e2b9-2b00-4e73-8d51-6d064e38e595 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:46.177341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:46.182337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5941dad-95c5-4d96-a6ed-f7cfaee3ff25 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:46.182835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5941dad-95c5-4d96-a6ed-f7cfaee3ff25 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:46.182943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5941dad-95c5-4d96-a6ed-f7cfaee3ff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:46.200356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e5941dad-95c5-4d96-a6ed-f7cfaee3ff25 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:46.201527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e5941dad-95c5-4d96-a6ed-f7cfaee3ff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:46.209604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:46.361577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e2b9-2b00-4e73-8d51-6d064e38e595 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:46.375723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e2b9-2b00-4e73-8d51-6d064e38e595 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:46.380975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654def0-ca87-40e3-aa48-c0fcfb3c0115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:46.381591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654def0-ca87-40e3-aa48-c0fcfb3c0115 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:46.381874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654def0-ca87-40e3-aa48-c0fcfb3c0115 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:46.382146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654def0-ca87-40e3-aa48-c0fcfb3c0115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:46.390039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654def0-ca87-40e3-aa48-c0fcfb3c0115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:46.391626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654def0-ca87-40e3-aa48-c0fcfb3c0115 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:46.400842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 719/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:47.220095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd98227-21b4-44d7-91d0-a498ec2f3cd8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:47.220651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd98227-21b4-44d7-91d0-a498ec2f3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:47.220651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd98227-21b4-44d7-91d0-a498ec2f3cd8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:47.222025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:47.227076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d2b6-9fb0-4064-b92b-82f04d6d9d97 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:47.227481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d2b6-9fb0-4064-b92b-82f04d6d9d97 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:47.227637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d2b6-9fb0-4064-b92b-82f04d6d9d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:47.245673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fe45d2b6-9fb0-4064-b92b-82f04d6d9d97 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:47.247717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fe45d2b6-9fb0-4064-b92b-82f04d6d9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:47.255458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:47.405248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd98227-21b4-44d7-91d0-a498ec2f3cd8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:47.419181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd98227-21b4-44d7-91d0-a498ec2f3cd8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:47.424586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a2fd-a631-41c3-95e1-c5009353cfc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:47.425242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a2fd-a631-41c3-95e1-c5009353cfc5 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:47.425520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a2fd-a631-41c3-95e1-c5009353cfc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:47.425791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a2fd-a631-41c3-95e1-c5009353cfc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:47.433692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a2fd-a631-41c3-95e1-c5009353cfc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:47.435278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a2fd-a631-41c3-95e1-c5009353cfc5 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:47.444404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 717/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:48.237887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145308-b593-4f9b-a35c-4353fc69a984 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:48.238460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145308-b593-4f9b-a35c-4353fc69a984 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:48.238460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145308-b593-4f9b-a35c-4353fc69a984 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:48.239863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:48.244771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54ffa-b442-47cf-b7f0-daec83b68dc2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:48.245146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54ffa-b442-47cf-b7f0-daec83b68dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:48.245333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54ffa-b442-47cf-b7f0-daec83b68dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:48.263811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c7f54ffa-b442-47cf-b7f0-daec83b68dc2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:48.265024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c7f54ffa-b442-47cf-b7f0-daec83b68dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:48.272771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:48.423477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145308-b593-4f9b-a35c-4353fc69a984 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:48.437706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e145308-b593-4f9b-a35c-4353fc69a984 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:48.443074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e754f88-a862-4fa7-b5ef-6e78a3f8df4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:48.443705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e754f88-a862-4fa7-b5ef-6e78a3f8df4e service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:48.443991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e754f88-a862-4fa7-b5ef-6e78a3f8df4e service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:48.444272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e754f88-a862-4fa7-b5ef-6e78a3f8df4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:48.452246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e754f88-a862-4fa7-b5ef-6e78a3f8df4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:48.453817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e754f88-a862-4fa7-b5ef-6e78a3f8df4e service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:48.463083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 722/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:50.384743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a259-80dd-4bd5-9cc6-fe9ed22f4c14 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:50.385344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a259-80dd-4bd5-9cc6-fe9ed22f4c14 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:50.385344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a259-80dd-4bd5-9cc6-fe9ed22f4c14 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:50.386761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:50.392010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9ee1-ede7-4ddf-a3be-f6a1f9ece513 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:50.392464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9ee1-ede7-4ddf-a3be-f6a1f9ece513 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:50.392683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d9ee1-ede7-4ddf-a3be-f6a1f9ece513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:50.410006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-077d9ee1-ede7-4ddf-a3be-f6a1f9ece513 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:50.411223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-077d9ee1-ede7-4ddf-a3be-f6a1f9ece513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:50.419488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:50.457456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4a259-80dd-4bd5-9cc6-fe9ed22f4c14 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:50.467998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4a259-80dd-4bd5-9cc6-fe9ed22f4c14 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:50.471459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db792-8e9a-4ff4-9818-1700e90c8b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:50.472081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db792-8e9a-4ff4-9818-1700e90c8b7a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:50.472361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db792-8e9a-4ff4-9818-1700e90c8b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:50.472636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db792-8e9a-4ff4-9818-1700e90c8b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:50.481902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db792-8e9a-4ff4-9818-1700e90c8b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:50.483378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db792-8e9a-4ff4-9818-1700e90c8b7a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:50.492679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 720/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:52.638161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561d58-5cd7-4c10-b6b3-880417ce7722 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:52.638724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561d58-5cd7-4c10-b6b3-880417ce7722 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:52.638724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561d58-5cd7-4c10-b6b3-880417ce7722 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:52.640117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:52.645289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613cef-a906-4069-a9f9-9c1b84420ea0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:52.645681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613cef-a906-4069-a9f9-9c1b84420ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:52.645844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf613cef-a906-4069-a9f9-9c1b84420ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:52.663851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bf613cef-a906-4069-a9f9-9c1b84420ea0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:52.665033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf613cef-a906-4069-a9f9-9c1b84420ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:52.672762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:52.709823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b561d58-5cd7-4c10-b6b3-880417ce7722 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:52.720826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b561d58-5cd7-4c10-b6b3-880417ce7722 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:52.724296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12848a70-f13b-4c4c-bb42-f14e1462e82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:52.724916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848a70-f13b-4c4c-bb42-f14e1462e82b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:52.725195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848a70-f13b-4c4c-bb42-f14e1462e82b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:52.725470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848a70-f13b-4c4c-bb42-f14e1462e82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:52.734105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12848a70-f13b-4c4c-bb42-f14e1462e82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:52.735542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12848a70-f13b-4c4c-bb42-f14e1462e82b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:52.745185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 725/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:55.054612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea5e45-576b-4f9b-b6e6-c1cbb8113eee None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:55.055063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea5e45-576b-4f9b-b6e6-c1cbb8113eee None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:55.055249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea5e45-576b-4f9b-b6e6-c1cbb8113eee None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:55.056526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:55.061608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b894a9-cfd8-4922-9d86-21db0b08e7ce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:55.062003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b894a9-cfd8-4922-9d86-21db0b08e7ce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:55.062152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b894a9-cfd8-4922-9d86-21db0b08e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:55.080066 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d7b894a9-cfd8-4922-9d86-21db0b08e7ce None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:55.081293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7b894a9-cfd8-4922-9d86-21db0b08e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:55.089142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:55.127823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea5e45-576b-4f9b-b6e6-c1cbb8113eee None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:55.138908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea5e45-576b-4f9b-b6e6-c1cbb8113eee None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:55.142395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da135ef-0247-41b9-b10d-be4dcfab1a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:55.143014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da135ef-0247-41b9-b10d-be4dcfab1a36 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:55.143291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da135ef-0247-41b9-b10d-be4dcfab1a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:55.143560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da135ef-0247-41b9-b10d-be4dcfab1a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:55.152313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da135ef-0247-41b9-b10d-be4dcfab1a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:55.153713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da135ef-0247-41b9-b10d-be4dcfab1a36 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:55.162725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 723/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:57.286684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4d24-bcc6-4c7f-ae4e-ead622b83c51 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:57.287237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4d24-bcc6-4c7f-ae4e-ead622b83c51 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:57.287344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4d24-bcc6-4c7f-ae4e-ead622b83c51 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:57.288655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:57.294673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c88b-61ba-4f0e-9257-4439bc2bb9f0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:57.295066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c88b-61ba-4f0e-9257-4439bc2bb9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:57.295238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c88b-61ba-4f0e-9257-4439bc2bb9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:57.313132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8436c88b-61ba-4f0e-9257-4439bc2bb9f0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:57.314355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8436c88b-61ba-4f0e-9257-4439bc2bb9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:57.322507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:57.361721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4d24-bcc6-4c7f-ae4e-ead622b83c51 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:57.372706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4d24-bcc6-4c7f-ae4e-ead622b83c51 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:57.376240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf0f6-7d09-4bf1-b6ce-2a5c44a9fbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:57.376874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf0f6-7d09-4bf1-b6ce-2a5c44a9fbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:57.377156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf0f6-7d09-4bf1-b6ce-2a5c44a9fbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:57.377430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf0f6-7d09-4bf1-b6ce-2a5c44a9fbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:57.386132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf0f6-7d09-4bf1-b6ce-2a5c44a9fbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:57.387587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf0f6-7d09-4bf1-b6ce-2a5c44a9fbb5 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:57.396864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 728/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:59.464213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17f57-4c87-4a91-b658-9bafa8d40bdc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:59.465367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17f57-4c87-4a91-b658-9bafa8d40bdc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:59.465367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b17f57-4c87-4a91-b658-9bafa8d40bdc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:59.466784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:03:59.471867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d41887-0c7a-4dc7-905d-54a9433c40f4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:59.472251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d41887-0c7a-4dc7-905d-54a9433c40f4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:59.472426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d41887-0c7a-4dc7-905d-54a9433c40f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:59.489738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-89d41887-0c7a-4dc7-905d-54a9433c40f4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:03:59.491080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-89d41887-0c7a-4dc7-905d-54a9433c40f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:03:59.499267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:03:59.536648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b17f57-4c87-4a91-b658-9bafa8d40bdc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:03:59.547156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b17f57-4c87-4a91-b658-9bafa8d40bdc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:03:59.550602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8c68f-537c-484c-b1ac-c5ac4882d52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:03:59.551231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8c68f-537c-484c-b1ac-c5ac4882d52f service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:03:59.551513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8c68f-537c-484c-b1ac-c5ac4882d52f service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:03:59.551790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8c68f-537c-484c-b1ac-c5ac4882d52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:03:59.560497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8c68f-537c-484c-b1ac-c5ac4882d52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:03:59.561911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8c68f-537c-484c-b1ac-c5ac4882d52f service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:03:59.571188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 726/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:01.652652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ad964-5b2e-4a43-bec2-be7ad9f9089e None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:01.653206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ad964-5b2e-4a43-bec2-be7ad9f9089e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:01.653206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ad964-5b2e-4a43-bec2-be7ad9f9089e None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:01.654626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:01.659708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a4b42-1f3b-4b04-82db-4e164a2c407a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:01.660159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a4b42-1f3b-4b04-82db-4e164a2c407a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:01.660267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a4b42-1f3b-4b04-82db-4e164a2c407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:01.677666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cb6a4b42-1f3b-4b04-82db-4e164a2c407a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:01.678901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cb6a4b42-1f3b-4b04-82db-4e164a2c407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:01.686576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:01.724246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ad964-5b2e-4a43-bec2-be7ad9f9089e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:01.734894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ad964-5b2e-4a43-bec2-be7ad9f9089e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:01.738334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd5528-720a-473b-b0db-9f5b4cc225d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:01.738957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5528-720a-473b-b0db-9f5b4cc225d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:01.739236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5528-720a-473b-b0db-9f5b4cc225d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:01.739510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd5528-720a-473b-b0db-9f5b4cc225d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:01.748387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5528-720a-473b-b0db-9f5b4cc225d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:01.749797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd5528-720a-473b-b0db-9f5b4cc225d3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:01.758947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 731/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:03.806706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a1730-d2c9-4030-9759-729179377181 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:03.807265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a1730-d2c9-4030-9759-729179377181 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:03.807265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a1730-d2c9-4030-9759-729179377181 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:03.809223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:03.814469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ec479-2ab4-4e85-84d0-026743e6ae78 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:03.814863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ec479-2ab4-4e85-84d0-026743e6ae78 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:03.815026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ec479-2ab4-4e85-84d0-026743e6ae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:03.832804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a64ec479-2ab4-4e85-84d0-026743e6ae78 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:03.833975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a64ec479-2ab4-4e85-84d0-026743e6ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:03.841595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:03.879607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a1730-d2c9-4030-9759-729179377181 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:03.890027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a1730-d2c9-4030-9759-729179377181 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:03.893487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb05d2-9c9b-480f-bcd7-bba431186e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:03.894110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb05d2-9c9b-480f-bcd7-bba431186e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:03.894425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb05d2-9c9b-480f-bcd7-bba431186e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:03.894705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb05d2-9c9b-480f-bcd7-bba431186e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:03.903405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb05d2-9c9b-480f-bcd7-bba431186e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:03.904819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb05d2-9c9b-480f-bcd7-bba431186e38 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:03.914102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 729/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:05.967710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce52cb-a2c8-48f0-9ea4-eb562c057c6f None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:05.968282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce52cb-a2c8-48f0-9ea4-eb562c057c6f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:05.968282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce52cb-a2c8-48f0-9ea4-eb562c057c6f None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:05.969648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:05.974794 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d4c23-cf18-4100-a482-0be0fe79aaa3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:05.975201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d4c23-cf18-4100-a482-0be0fe79aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:05.975439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d4c23-cf18-4100-a482-0be0fe79aaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:05.981973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=79 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:04:05.994422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5e7d4c23-cf18-4100-a482-0be0fe79aaa3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:05.996207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5e7d4c23-cf18-4100-a482-0be0fe79aaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:06.004160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:06.040725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce52cb-a2c8-48f0-9ea4-eb562c057c6f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:06.046650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=73 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:04:06.053100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce52cb-a2c8-48f0-9ea4-eb562c057c6f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:06.056670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ead6f-358c-4f21-a7ff-e8a412db5399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:06.057324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ead6f-358c-4f21-a7ff-e8a412db5399 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:06.057608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ead6f-358c-4f21-a7ff-e8a412db5399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:06.057884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ead6f-358c-4f21-a7ff-e8a412db5399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:06.067322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ead6f-358c-4f21-a7ff-e8a412db5399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:06.068723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ead6f-358c-4f21-a7ff-e8a412db5399 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:06.077918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 734/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:08.099673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992145-bdeb-4f83-8878-30e8fe4df547 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:08.100181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992145-bdeb-4f83-8878-30e8fe4df547 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:08.100278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992145-bdeb-4f83-8878-30e8fe4df547 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:08.101599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:08.107278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c51d-5d11-42e8-8b1f-5159464c6c8e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:08.107673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c51d-5d11-42e8-8b1f-5159464c6c8e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:08.107869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c51d-5d11-42e8-8b1f-5159464c6c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:08.125638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d7a3c51d-5d11-42e8-8b1f-5159464c6c8e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:08.126896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d7a3c51d-5d11-42e8-8b1f-5159464c6c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:08.134738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:08.171330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992145-bdeb-4f83-8878-30e8fe4df547 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:08.181885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992145-bdeb-4f83-8878-30e8fe4df547 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:08.185384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953350ed-c445-428e-9eec-8c7bce6d6236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:08.186009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953350ed-c445-428e-9eec-8c7bce6d6236 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:08.186326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953350ed-c445-428e-9eec-8c7bce6d6236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:08.186605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953350ed-c445-428e-9eec-8c7bce6d6236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:08.195297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953350ed-c445-428e-9eec-8c7bce6d6236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:08.196712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953350ed-c445-428e-9eec-8c7bce6d6236 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:08.206458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 732/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:10.232757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cce8c-1de7-46fa-8f5a-110161bc0240 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:10.233318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cce8c-1de7-46fa-8f5a-110161bc0240 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:10.233318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cce8c-1de7-46fa-8f5a-110161bc0240 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:10.234734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:10.239811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec695a3-d673-4b56-8025-4e67d57d8185 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:10.240174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec695a3-d673-4b56-8025-4e67d57d8185 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:10.240378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec695a3-d673-4b56-8025-4e67d57d8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:10.258525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aec695a3-d673-4b56-8025-4e67d57d8185 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:10.259709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aec695a3-d673-4b56-8025-4e67d57d8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:10.268073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:10.303414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cce8c-1de7-46fa-8f5a-110161bc0240 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:10.314342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cce8c-1de7-46fa-8f5a-110161bc0240 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:10.317762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b2c69-00df-466b-863b-f71e707eef9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:10.318409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b2c69-00df-466b-863b-f71e707eef9e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:10.318690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b2c69-00df-466b-863b-f71e707eef9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:10.318962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b2c69-00df-466b-863b-f71e707eef9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:10.328196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b2c69-00df-466b-863b-f71e707eef9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:10.329608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b2c69-00df-466b-863b-f71e707eef9e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:10.338781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 737/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:20.253488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=11 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:04:20.334763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=14 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:04:30.103130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465b76-29e3-4b75-9fc3-30c441288f88 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:30.103717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465b76-29e3-4b75-9fc3-30c441288f88 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:30.103717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8465b76-29e3-4b75-9fc3-30c441288f88 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:30.105120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 734/1471] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:30.110608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ede7-2b96-41f4-8bf2-5098908197f7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:30.111043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ede7-2b96-41f4-8bf2-5098908197f7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:30.111517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363ede7-2b96-41f4-8bf2-5098908197f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:30.133543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f363ede7-2b96-41f4-8bf2-5098908197f7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:30.134764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f363ede7-2b96-41f4-8bf2-5098908197f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:30.142999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 738/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:30.189553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3879d6-7090-45d1-a69b-66377385b0c7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:30.189845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3879d6-7090-45d1-a69b-66377385b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:30.190128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3879d6-7090-45d1-a69b-66377385b0c7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:30.191527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 735/1473] 10.222.0.16 () {54 vars in 962 bytes} [Fri Jun 24 09:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:30.196189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed542d-d63a-49ed-b91f-65f69459f04d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:30.196503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed542d-d63a-49ed-b91f-65f69459f04d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:30.196780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed542d-d63a-49ed-b91f-65f69459f04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:30.215287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9bed542d-d63a-49ed-b91f-65f69459f04d None None] MFA Rules not processed for user `0713044ffd0247fe8a983d3d1ee15a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:30.216444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9bed542d-d63a-49ed-b91f-65f69459f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:30.222709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 739/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Jun 24 09:04:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:30.229865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3879d6-7090-45d1-a69b-66377385b0c7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:30.240333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3879d6-7090-45d1-a69b-66377385b0c7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:30.243831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa244a4-5348-4d00-88f8-7b8400a1e0ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:30.244452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa244a4-5348-4d00-88f8-7b8400a1e0ae service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:30.244739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa244a4-5348-4d00-88f8-7b8400a1e0ae service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:30.245017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa244a4-5348-4d00-88f8-7b8400a1e0ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:30.254029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa244a4-5348-4d00-88f8-7b8400a1e0ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:30.255469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa244a4-5348-4d00-88f8-7b8400a1e0ae service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:30.265194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 736/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:32.361745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55139f4-f81e-499c-a084-7a69e56fbcc5 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:32.362289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55139f4-f81e-499c-a084-7a69e56fbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:32.362421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55139f4-f81e-499c-a084-7a69e56fbcc5 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:32.363743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 740/1476] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:32.368770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06239-8f07-45a9-8f00-8cb99b2f4d1b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:32.369187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06239-8f07-45a9-8f00-8cb99b2f4d1b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:32.369346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06239-8f07-45a9-8f00-8cb99b2f4d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:32.387553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5bd06239-8f07-45a9-8f00-8cb99b2f4d1b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:32.388793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5bd06239-8f07-45a9-8f00-8cb99b2f4d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:32.396581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 737/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:32.419835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55139f4-f81e-499c-a084-7a69e56fbcc5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:32.432584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55139f4-f81e-499c-a084-7a69e56fbcc5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:32.436939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:32.437572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:32.437849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:32.438119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:32.438872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:32.440644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:04:32.440644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:04:32.440644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:04:32.441782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a39221-3041-46d3-ae49-4fc9a1461277 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:32.460164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 741/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jun 24 09:04:32 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:04:34.487491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c5ca5-575f-4e62-ba15-4e6ae903448e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:34.488055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c5ca5-575f-4e62-ba15-4e6ae903448e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:34.488055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c5ca5-575f-4e62-ba15-4e6ae903448e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:34.489432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 738/1479] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:34.495138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1b7f7-49d9-4ce7-b8a2-0f720ca6f638 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:34.495599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1b7f7-49d9-4ce7-b8a2-0f720ca6f638 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:34.495712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1b7f7-49d9-4ce7-b8a2-0f720ca6f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:34.513671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-75f1b7f7-49d9-4ce7-b8a2-0f720ca6f638 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:34.514887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-75f1b7f7-49d9-4ce7-b8a2-0f720ca6f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:34.522519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 742/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:34.564837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c5ca5-575f-4e62-ba15-4e6ae903448e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:34.579113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c5ca5-575f-4e62-ba15-4e6ae903448e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:34.584399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2017f-901c-404b-8093-7191d23a71b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:34.585029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2017f-901c-404b-8093-7191d23a71b6 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:34.585311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2017f-901c-404b-8093-7191d23a71b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:34.585587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2017f-901c-404b-8093-7191d23a71b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:34.593684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2017f-901c-404b-8093-7191d23a71b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:34.595280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2017f-901c-404b-8093-7191d23a71b6 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:34.604973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 739/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:36.787625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c0063-81d5-4b7a-b6f5-b3c662f7367d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:36.788158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c0063-81d5-4b7a-b6f5-b3c662f7367d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:36.788287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c0063-81d5-4b7a-b6f5-b3c662f7367d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:36.789572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 743/1482] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:36.794939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b2a3-c5b2-4cf8-bdda-2a95534cbff3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:36.795356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b2a3-c5b2-4cf8-bdda-2a95534cbff3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:36.795492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76b2a3-c5b2-4cf8-bdda-2a95534cbff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:36.813236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4a76b2a3-c5b2-4cf8-bdda-2a95534cbff3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:36.814452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4a76b2a3-c5b2-4cf8-bdda-2a95534cbff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:36.823133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 740/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:36.859245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c0063-81d5-4b7a-b6f5-b3c662f7367d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:36.869941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c0063-81d5-4b7a-b6f5-b3c662f7367d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:36.873738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86c812-2aa9-4491-9360-1cee854f0402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:36.874405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c812-2aa9-4491-9360-1cee854f0402 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:36.874690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c812-2aa9-4491-9360-1cee854f0402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:36.874967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86c812-2aa9-4491-9360-1cee854f0402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:36.883896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c812-2aa9-4491-9360-1cee854f0402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:36.885855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86c812-2aa9-4491-9360-1cee854f0402 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:36.895419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 744/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:38.977528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e2ac0-6a80-409d-8b07-112ebb5a6755 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:38.978474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e2ac0-6a80-409d-8b07-112ebb5a6755 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:38.978754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e2ac0-6a80-409d-8b07-112ebb5a6755 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:38.980280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 741/1485] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:38.986320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4e4c-32a9-4905-a1dd-204aa4779a1d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:38.986751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4e4c-32a9-4905-a1dd-204aa4779a1d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:38.986886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4e4c-32a9-4905-a1dd-204aa4779a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:39.004266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fa7a4e4c-32a9-4905-a1dd-204aa4779a1d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:39.005460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fa7a4e4c-32a9-4905-a1dd-204aa4779a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:39.013730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 745/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:39.051282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e2ac0-6a80-409d-8b07-112ebb5a6755 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:39.062179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e2ac0-6a80-409d-8b07-112ebb5a6755 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:39.065716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9406b-acde-4755-8449-d4e3a1aa66ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:39.066376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9406b-acde-4755-8449-d4e3a1aa66ba service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:39.066658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9406b-acde-4755-8449-d4e3a1aa66ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:39.066930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9406b-acde-4755-8449-d4e3a1aa66ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:39.076096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9406b-acde-4755-8449-d4e3a1aa66ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:39.077502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9406b-acde-4755-8449-d4e3a1aa66ba service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:39.086594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 742/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:41.207741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001ef54-6cc9-457b-bfb4-dde350f7a7a4 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:41.208278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001ef54-6cc9-457b-bfb4-dde350f7a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:41.208372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001ef54-6cc9-457b-bfb4-dde350f7a7a4 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:41.209687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 746/1488] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:41.214878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1865e8-f898-4e1c-b4b7-12fce63b236a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:41.215323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1865e8-f898-4e1c-b4b7-12fce63b236a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:41.215444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1865e8-f898-4e1c-b4b7-12fce63b236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:41.234392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ab1865e8-f898-4e1c-b4b7-12fce63b236a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:41.235604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ab1865e8-f898-4e1c-b4b7-12fce63b236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:41.243513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 743/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:41.284082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001ef54-6cc9-457b-bfb4-dde350f7a7a4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:41.295462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001ef54-6cc9-457b-bfb4-dde350f7a7a4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:41.299003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f95cd-4907-456b-a4d5-92cb6fc0a89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:41.299628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f95cd-4907-456b-a4d5-92cb6fc0a89f service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:41.299909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f95cd-4907-456b-a4d5-92cb6fc0a89f service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:41.300185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f95cd-4907-456b-a4d5-92cb6fc0a89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:41.309592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f95cd-4907-456b-a4d5-92cb6fc0a89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:41.311030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f95cd-4907-456b-a4d5-92cb6fc0a89f service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:41.320173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 747/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:43.609043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9b95e-84bb-45ed-8de8-07ac9e8b05d1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:43.609601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9b95e-84bb-45ed-8de8-07ac9e8b05d1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:43.609712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9b95e-84bb-45ed-8de8-07ac9e8b05d1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:43.611057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 744/1491] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jun 24 09:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:04:43.616727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a619203-3c2a-4716-a2ed-614139e271cc None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:43.617123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a619203-3c2a-4716-a2ed-614139e271cc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:43.617290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a619203-3c2a-4716-a2ed-614139e271cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:43.636404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9a619203-3c2a-4716-a2ed-614139e271cc None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:04:43.637592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9a619203-3c2a-4716-a2ed-614139e271cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:04:43.645314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 748/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jun 24 09:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:04:43.684333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9b95e-84bb-45ed-8de8-07ac9e8b05d1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:43.694845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9b95e-84bb-45ed-8de8-07ac9e8b05d1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:43.698329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3f42b-08b9-4551-920f-561009579896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:43.698954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f42b-08b9-4551-920f-561009579896 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:43.699235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f42b-08b9-4551-920f-561009579896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:43.699516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3f42b-08b9-4551-920f-561009579896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:43.708123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3f42b-08b9-4551-920f-561009579896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:43.709531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3f42b-08b9-4551-920f-561009579896 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:43.718756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 745/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:04:53.631417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=33 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:04:53.714658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=33 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:06:07.506146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.506766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.506766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.524609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:06:07.525841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:07.533694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 749/1494] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:06:07.543442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.543930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.544042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.562032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:06:07.563243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:07.570922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 746/1495] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:06:07.575287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:07.584888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd4d81-0844-4935-a36d-4d41b137c20d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:07.589353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:07.589997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.590314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.590600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.591358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:06:07.591673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:07.592689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:07.592689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:06:07.592689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:06:07.593574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:07.605474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 750/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:06:07.613359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:07.623241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d417e63-f240-41dd-8d4b-8709d635fc37 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:07.627846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:07.628488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.628775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.629053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.629757 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:07.631533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:07.631533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:06:07.631533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:06:07.632750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:07.668272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 747/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:06:07 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:06:07.672349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:07.682763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01279a4-385f-4b88-8122-2cb3ca089be0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:07.736537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:07.737198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.737554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.737863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.738583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:07.739574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:07.739574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:06:07.739574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:06:07.740770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:07.760111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 751/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:06:07 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:06:07.764210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:07.775045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c29e3-2c47-413c-b4ba-19876fa0e392 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:07.779657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:07.780337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.780617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.780891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.781624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:07.782660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:07.782660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:06:07.782660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:06:07.783535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:07.796323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 748/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:06:07.800881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:07.810916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab09a0-a91d-4aed-a89e-151f8270d65c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:07.815417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:07.816060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.816340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.816610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.817331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:07.818371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:07.818371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:06:07.818371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:06:07.819870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07fad6-5d18-47ae-9e0f-a7898bcd39a3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:07.832746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 752/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:06:07.837578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:07.847493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e664f-967f-4575-9d01-b6725b151ebd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:07.852018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:07.852887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.853169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.853464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] PATH_INFO: `/v3/projects/a4df610964824546b53dfab6fb43a405/users/5e887805e27345a5902f80683d7293e2/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.868219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4df610964824546b53dfab6fb43a405, user_id=5e887805e27345a5902f80683d7293e2, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:07.869234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:07.869234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:06:07.869234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:06:07.871198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe758aa-56c5-4722-9b0b-c5f14d46f3a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:07.884538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 749/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:06:07 2022] PUT /identity/v3/projects/a4df610964824546b53dfab6fb43a405/users/5e887805e27345a5902f80683d7293e2/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:06:07.895558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ad900-5199-410f-9a88-5585746c8166 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:07.895849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ad900-5199-410f-9a88-5585746c8166 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:07.896129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ad900-5199-410f-9a88-5585746c8166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:07.921254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-843ad900-5199-410f-9a88-5585746c8166 None None] MFA Rules not processed for user `5e887805e27345a5902f80683d7293e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:06:07.922463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-843ad900-5199-410f-9a88-5585746c8166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:07.986879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 753/1502] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:06:08.000584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3f98-43ea-445b-b9a1-602c96d1bf9c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.000878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3f98-43ea-445b-b9a1-602c96d1bf9c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.001163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3f98-43ea-445b-b9a1-602c96d1bf9c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.002604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 750/1503] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jun 24 09:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:06:08.007934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce55d-e26c-473a-9d4b-6c8f21e73b0c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.008221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce55d-e26c-473a-9d4b-6c8f21e73b0c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.008498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ce55d-e26c-473a-9d4b-6c8f21e73b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.026076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bc5ce55d-e26c-473a-9d4b-6c8f21e73b0c None None] MFA Rules not processed for user `78768c5fb13646dcad006e323df270a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:06:08.027236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bc5ce55d-e26c-473a-9d4b-6c8f21e73b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:08.068893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:06:08.077688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 754/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jun 24 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:06:08.085416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3f98-43ea-445b-b9a1-602c96d1bf9c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:08.095753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3f98-43ea-445b-b9a1-602c96d1bf9c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:08.099251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:08.099873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.100153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.100426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.108493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:08.109887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:08.119031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 751/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:06:08.160445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b24e-e721-47c4-b782-bcc3e20bb233 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.160740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b24e-e721-47c4-b782-bcc3e20bb233 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.161020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b24e-e721-47c4-b782-bcc3e20bb233 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.162387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 755/1506] 10.222.0.16 () {52 vars in 829 bytes} [Fri Jun 24 09:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:06:08.165937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:08.226503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdedf9d-70fb-4223-ab91-5c9f88aaf966 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:08.231101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:08.231962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.232240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.232509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] PATH_INFO: `/v3/users/5e887805e27345a5902f80683d7293e2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.233738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e887805e27345a5902f80683d7293e2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:08.234795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:08.234795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:06:08.234795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:06:08.235989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:08.300297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e887805e27345a5902f80683d7293e2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.313283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e887805e27345a5902f80683d7293e2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.313916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e887805e27345a5902f80683d7293e2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.322889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e887805e27345a5902f80683d7293e2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.323585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e887805e27345a5902f80683d7293e2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.339864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:06:08.349784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 752/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:06:08 2022] DELETE /identity/v3/users/5e887805e27345a5902f80683d7293e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:06:08.354893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.355187 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.355494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.373251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:06:08.374477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:08.431135 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 756/1508] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:06:08.440587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:08.442012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:08.497865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce563f-3e4f-4d3a-ab17-b654c26be261 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:08.501408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e29a-d077-4876-9669-836f7b00ed4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:08.502045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e29a-d077-4876-9669-836f7b00ed4f service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.502367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e29a-d077-4876-9669-836f7b00ed4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.502645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e29a-d077-4876-9669-836f7b00ed4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.511360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e29a-d077-4876-9669-836f7b00ed4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:08.512778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e29a-d077-4876-9669-836f7b00ed4f service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:08.522032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 753/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:06:08.867527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:06:08.868889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:06:08.881038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd105dc-b4bf-4df2-9f05-3168b8b5e1eb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:06:08.886727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:06:08.887809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:06:08.888094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:06:08.888370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] PATH_INFO: `/v3/projects/a4df610964824546b53dfab6fb43a405` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:06:08.889594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4df610964824546b53dfab6fb43a405)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:06:08.890589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:06:08.890589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:06:08.890589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:06:08.892742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:06:08.953828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4df610964824546b53dfab6fb43a405', 'request_id': 'req-66bebb07-83a2-4c34-85c8-9c748101e0a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.959992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4df610964824546b53dfab6fb43a405', 'request_id': 'req-66bebb07-83a2-4c34-85c8-9c748101e0a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.972996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4df610964824546b53dfab6fb43a405', 'request_id': 'req-66bebb07-83a2-4c34-85c8-9c748101e0a6'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.988734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] The token cache is being invalidate because project a4df610964824546b53dfab6fb43a405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:06:08.989032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.989769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66bebb07-83a2-4c34-85c8-9c748101e0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:06:08.991958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 757/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:06:08 2022] DELETE /identity/v3/projects/a4df610964824546b53dfab6fb43a405 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:06:18.517958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:06:18.985556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:07:55.211550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e466ad-850f-439f-a496-e7e9722264c2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:55.212060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e466ad-850f-439f-a496-e7e9722264c2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:55.212165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e466ad-850f-439f-a496-e7e9722264c2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:55.213619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:07:55.218602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a410-49fb-4406-bfed-7e7c8f96bab0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:55.219047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a410-49fb-4406-bfed-7e7c8f96bab0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:55.219199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37a410-49fb-4406-bfed-7e7c8f96bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:55.237017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cb37a410-49fb-4406-bfed-7e7c8f96bab0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:07:55.238268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cb37a410-49fb-4406-bfed-7e7c8f96bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:07:55.295484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:07:55.450574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e466ad-850f-439f-a496-e7e9722264c2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:07:55.452283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1e466ad-850f-439f-a496-e7e9722264c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:07:55.526694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e466ad-850f-439f-a496-e7e9722264c2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:07:55.533934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53462a-5570-4232-a9ef-60809cc27943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:07:55.534915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53462a-5570-4232-a9ef-60809cc27943 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:55.535973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53462a-5570-4232-a9ef-60809cc27943 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:55.536508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53462a-5570-4232-a9ef-60809cc27943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:55.545255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53462a-5570-4232-a9ef-60809cc27943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:07:55.546956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53462a-5570-4232-a9ef-60809cc27943 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:07:55.556812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 755/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:07:56.377444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be54d-f6c0-4cbf-b649-3fd241b79183 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:56.377967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be54d-f6c0-4cbf-b649-3fd241b79183 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:56.377967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be54d-f6c0-4cbf-b649-3fd241b79183 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:56.379850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:07:56.384705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc299b-9fd1-4332-b2db-a576bf375d17 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:56.385095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc299b-9fd1-4332-b2db-a576bf375d17 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:56.385307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc299b-9fd1-4332-b2db-a576bf375d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:56.403535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-87cc299b-9fd1-4332-b2db-a576bf375d17 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:07:56.404747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87cc299b-9fd1-4332-b2db-a576bf375d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:07:56.412885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:07:56.564201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be54d-f6c0-4cbf-b649-3fd241b79183 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:07:56.579086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be54d-f6c0-4cbf-b649-3fd241b79183 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:07:56.584766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0002f4-a51b-490b-801b-31c8af1306af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:07:56.585406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0002f4-a51b-490b-801b-31c8af1306af service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:56.585691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0002f4-a51b-490b-801b-31c8af1306af service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:56.585970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0002f4-a51b-490b-801b-31c8af1306af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:56.594089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0002f4-a51b-490b-801b-31c8af1306af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:07:56.595718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0002f4-a51b-490b-801b-31c8af1306af service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:07:56.604981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 760/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:07:57.280598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ef02-684b-4d19-8928-0a0acebb1f04 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:57.280795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ef02-684b-4d19-8928-0a0acebb1f04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:57.281106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ef02-684b-4d19-8928-0a0acebb1f04 None None] PATH_INFO: `/v3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:57.282459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 757/1517] 10.222.0.18 () {54 vars in 925 bytes} [Fri Jun 24 09:07:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:07:57.288949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490414-fad8-4e73-9f76-42a1acc0ebe6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:57.289244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490414-fad8-4e73-9f76-42a1acc0ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:57.289527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490414-fad8-4e73-9f76-42a1acc0ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:57.308076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4e490414-fad8-4e73-9f76-42a1acc0ebe6 None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:07:57.309277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4e490414-fad8-4e73-9f76-42a1acc0ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:07:57.370159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 761/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Jun 24 09:07:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:01.202152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cff9e1-4b5d-4759-a28d-35acc017f27f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:01.202670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cff9e1-4b5d-4759-a28d-35acc017f27f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:01.202670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cff9e1-4b5d-4759-a28d-35acc017f27f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:01.204026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 758/1519] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jun 24 09:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:01.209108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892d256-2837-4a48-ba2c-4866f34f9205 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:01.209499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892d256-2837-4a48-ba2c-4866f34f9205 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:01.209658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892d256-2837-4a48-ba2c-4866f34f9205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:01.228738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1892d256-2837-4a48-ba2c-4866f34f9205 None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:01.229915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1892d256-2837-4a48-ba2c-4866f34f9205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:01.238239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 762/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jun 24 09:08:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:01.246038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cff9e1-4b5d-4759-a28d-35acc017f27f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:01.260771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cff9e1-4b5d-4759-a28d-35acc017f27f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:01.265840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9e3d-b6b8-44ff-81b1-c9ae812ac039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:01.266535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9e3d-b6b8-44ff-81b1-c9ae812ac039 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:01.266816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9e3d-b6b8-44ff-81b1-c9ae812ac039 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:01.267092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9e3d-b6b8-44ff-81b1-c9ae812ac039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:01.275856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb9e3d-b6b8-44ff-81b1-c9ae812ac039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:01.277423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb9e3d-b6b8-44ff-81b1-c9ae812ac039 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:01.287457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 759/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:07.815402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ffac-a411-49a5-9e42-0aeda07dcc4b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:07.815978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ffac-a411-49a5-9e42-0aeda07dcc4b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:07.815978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823ffac-a411-49a5-9e42-0aeda07dcc4b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:07.817878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:07.822666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d842-1862-4723-a79a-a188a633f37d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:07.823073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d842-1862-4723-a79a-a188a633f37d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:07.823232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d842-1862-4723-a79a-a188a633f37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:07.841419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2f22d842-1862-4723-a79a-a188a633f37d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:07.842632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2f22d842-1862-4723-a79a-a188a633f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:07.850363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:08.004463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ffac-a411-49a5-9e42-0aeda07dcc4b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:08.020370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823ffac-a411-49a5-9e42-0aeda07dcc4b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:08.025763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730cddb-8f9c-45a9-b916-6c9a9d6d6aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:08.026429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730cddb-8f9c-45a9-b916-6c9a9d6d6aeb service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:08.026786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730cddb-8f9c-45a9-b916-6c9a9d6d6aeb service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:08.027065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730cddb-8f9c-45a9-b916-6c9a9d6d6aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:08.036527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730cddb-8f9c-45a9-b916-6c9a9d6d6aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:08.038113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730cddb-8f9c-45a9-b916-6c9a9d6d6aeb service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:08.047330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 764/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:08.889160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba15b0e-0e42-4165-85c9-745127681899 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:08.889692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba15b0e-0e42-4165-85c9-745127681899 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:08.889825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba15b0e-0e42-4165-85c9-745127681899 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:08.891146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:08.895880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cdc9f-bb29-4d9c-b057-2fd34de19e3c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:08.896292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cdc9f-bb29-4d9c-b057-2fd34de19e3c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:08.896431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cdc9f-bb29-4d9c-b057-2fd34de19e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:08.914692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-170cdc9f-bb29-4d9c-b057-2fd34de19e3c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:08.915881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-170cdc9f-bb29-4d9c-b057-2fd34de19e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:08.923709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:08:09.075329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba15b0e-0e42-4165-85c9-745127681899 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:09.090100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba15b0e-0e42-4165-85c9-745127681899 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:09.095366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168c93b-7cd7-44c9-ab30-9a0f73e7ed12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:09.096059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c93b-7cd7-44c9-ab30-9a0f73e7ed12 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:09.096346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c93b-7cd7-44c9-ab30-9a0f73e7ed12 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:09.096620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168c93b-7cd7-44c9-ab30-9a0f73e7ed12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:09.105249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168c93b-7cd7-44c9-ab30-9a0f73e7ed12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:09.110823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168c93b-7cd7-44c9-ab30-9a0f73e7ed12 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:09.120393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 762/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:13.145462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273835a-f07f-4e16-b8d9-962fe2328fdb None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:13.145911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273835a-f07f-4e16-b8d9-962fe2328fdb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:13.146043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273835a-f07f-4e16-b8d9-962fe2328fdb None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:13.147431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:13.152772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9a55-dcc3-45a9-af1e-fc12670d893a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:13.153169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9a55-dcc3-45a9-af1e-fc12670d893a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:13.153326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9a55-dcc3-45a9-af1e-fc12670d893a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:13.173327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-68bb9a55-dcc3-45a9-af1e-fc12670d893a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:13.174560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-68bb9a55-dcc3-45a9-af1e-fc12670d893a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:13.182635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:13.220103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273835a-f07f-4e16-b8d9-962fe2328fdb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:13.221780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e273835a-f07f-4e16-b8d9-962fe2328fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:13.277841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273835a-f07f-4e16-b8d9-962fe2328fdb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:13.281393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a0241-29fa-427e-bc51-9cbeca940c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:13.281967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0241-29fa-427e-bc51-9cbeca940c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:13.282278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0241-29fa-427e-bc51-9cbeca940c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:13.282554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0241-29fa-427e-bc51-9cbeca940c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:13.291928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a0241-29fa-427e-bc51-9cbeca940c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:13.293337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a0241-29fa-427e-bc51-9cbeca940c5e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:13.298215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:08:13.303264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 767/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:15.334831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d255-f955-4d6c-b210-c12874643da6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:15.335345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d255-f955-4d6c-b210-c12874643da6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:15.335345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7d255-f955-4d6c-b210-c12874643da6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:15.336717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:15.341966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e56c-bdcc-44b2-8bda-e65866577833 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:15.342446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e56c-bdcc-44b2-8bda-e65866577833 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:15.342554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042e56c-bdcc-44b2-8bda-e65866577833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:15.360824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8042e56c-bdcc-44b2-8bda-e65866577833 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:15.362053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8042e56c-bdcc-44b2-8bda-e65866577833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:15.370445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:15.406594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7d255-f955-4d6c-b210-c12874643da6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:15.408283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-61f7d255-f955-4d6c-b210-c12874643da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:15.421668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7d255-f955-4d6c-b210-c12874643da6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:15.425269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e764-ac56-48c9-8081-15a0938fafe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:15.425902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e764-ac56-48c9-8081-15a0938fafe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:15.426749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e764-ac56-48c9-8081-15a0938fafe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:15.427039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e764-ac56-48c9-8081-15a0938fafe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:15.436110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e764-ac56-48c9-8081-15a0938fafe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:15.437521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e764-ac56-48c9-8081-15a0938fafe0 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:15.446948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 765/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:19.055286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f213-be74-4170-834b-db02ebf52b58 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:19.055782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f213-be74-4170-834b-db02ebf52b58 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:19.055902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f213-be74-4170-834b-db02ebf52b58 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:19.057292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:19.062321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cecb4-ac77-40eb-8c97-115e3bd84a5f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:19.062748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cecb4-ac77-40eb-8c97-115e3bd84a5f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:19.062911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cecb4-ac77-40eb-8c97-115e3bd84a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:19.069186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=62 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:08:19.081455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-110cecb4-ac77-40eb-8c97-115e3bd84a5f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:19.083197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-110cecb4-ac77-40eb-8c97-115e3bd84a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:19.090917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:19.389016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f213-be74-4170-834b-db02ebf52b58 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:19.390750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7534f213-be74-4170-834b-db02ebf52b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:19.447525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f213-be74-4170-834b-db02ebf52b58 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:19.451117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df07-1890-4751-865c-12c548ec2965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:19.451758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df07-1890-4751-865c-12c548ec2965 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:19.452045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df07-1890-4751-865c-12c548ec2965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:19.452325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df07-1890-4751-865c-12c548ec2965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:19.461757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df07-1890-4751-865c-12c548ec2965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:19.463217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df07-1890-4751-865c-12c548ec2965 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:19.472718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 770/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:21.522250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d641c5-7953-49cf-8ad1-b9b2f1bf8782 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:21.522804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d641c5-7953-49cf-8ad1-b9b2f1bf8782 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:21.522911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d641c5-7953-49cf-8ad1-b9b2f1bf8782 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:21.524254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:08:21.529290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e274148-1ea5-47cf-a84a-bc7f5e649cc4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:21.529755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e274148-1ea5-47cf-a84a-bc7f5e649cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:21.529851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e274148-1ea5-47cf-a84a-bc7f5e649cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:21.548387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6e274148-1ea5-47cf-a84a-bc7f5e649cc4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:08:21.549629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e274148-1ea5-47cf-a84a-bc7f5e649cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:21.558114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:08:21.857740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d641c5-7953-49cf-8ad1-b9b2f1bf8782 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:21.859424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a0d641c5-7953-49cf-8ad1-b9b2f1bf8782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:21.873190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d641c5-7953-49cf-8ad1-b9b2f1bf8782 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:21.876641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f7553-9b18-45a0-9d9f-c9437c0b516e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:21.877273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f7553-9b18-45a0-9d9f-c9437c0b516e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:21.877553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f7553-9b18-45a0-9d9f-c9437c0b516e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:21.877833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f7553-9b18-45a0-9d9f-c9437c0b516e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:21.887276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f7553-9b18-45a0-9d9f-c9437c0b516e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:21.888673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f7553-9b18-45a0-9d9f-c9437c0b516e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:21.897951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 768/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:31.543130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=32 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:08:31.893830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:56.023351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d537-a5dd-4307-9140-1ddba083bf8f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.023971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d537-a5dd-4307-9140-1ddba083bf8f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.023971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236d537-a5dd-4307-9140-1ddba083bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.032157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb519e0-121a-47eb-b4e8-ffd2ad5395fe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.033138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb519e0-121a-47eb-b4e8-ffd2ad5395fe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.033719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb519e0-121a-47eb-b4e8-ffd2ad5395fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.048102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9236d537-a5dd-4307-9140-1ddba083bf8f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.049562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9236d537-a5dd-4307-9140-1ddba083bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.060370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2bb519e0-121a-47eb-b4e8-ffd2ad5395fe None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.061908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2bb519e0-121a-47eb-b4e8-ffd2ad5395fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.066312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 772/1540] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:09:56.069066 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f310-3469-475d-8d26-ce96e3378657 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.074260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f310-3469-475d-8d26-ce96e3378657 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.074260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f310-3469-475d-8d26-ce96e3378657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.078901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 769/1541] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:09:56.080452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833fdfe-bcf2-460e-913c-83cd41e6211b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.080986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833fdfe-bcf2-460e-913c-83cd41e6211b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.081494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833fdfe-bcf2-460e-913c-83cd41e6211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.089748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4e76f310-3469-475d-8d26-ce96e3378657 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.090911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4e76f310-3469-475d-8d26-ce96e3378657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.100267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 773/1542] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:09:56.108976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.109275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.109542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.113663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c833fdfe-bcf2-460e-913c-83cd41e6211b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.115190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c833fdfe-bcf2-460e-913c-83cd41e6211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.128830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 770/1543] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.131691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.132571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.133156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.133484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.133989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.142490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 774/1544] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:09:56.143322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.153951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be68154-0488-4c60-8f15-31e0bf0ab2c9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.159433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.159786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.160860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.161148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.161904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.162190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.163831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450f369-f511-442c-99a3-25262df1c37d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.171484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.173019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.178034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 775/1545] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.179384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206790d-8f9e-4797-b5b7-8eb5813741bd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.179672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206790d-8f9e-4797-b5b7-8eb5813741bd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.179951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206790d-8f9e-4797-b5b7-8eb5813741bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.186819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 771/1546] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.187998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.200930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ebf9c-1e77-4c93-9eff-7cbefc95d0d7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.205893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.206609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.207444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.207722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.208459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.208652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8206790d-8f9e-4797-b5b7-8eb5813741bd None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.208770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.209773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:09:56.209773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:09:56.209773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:09:56.210047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8206790d-8f9e-4797-b5b7-8eb5813741bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.210709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c987e9c-67b0-4de4-afb3-3c43397eac28 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.218722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 776/1547] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.219297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204af25-b336-457b-896b-12b154164620 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.219608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204af25-b336-457b-896b-12b154164620 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.219883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204af25-b336-457b-896b-12b154164620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.228184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 772/1548] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.230057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.230387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.230669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.238510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2204af25-b336-457b-896b-12b154164620 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.239693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2204af25-b336-457b-896b-12b154164620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.247476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 777/1549] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.248928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.249187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.249324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.249472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.250668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.261168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 773/1550] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.262126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.270954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.272205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.272336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266b6c1-45e5-43a4-8046-c984c143050b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.276807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.277454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.277735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.278018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.278776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.279080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.280290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 778/1551] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.280983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.281130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8381ea-1ae0-4df3-8933-e665f551e0ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.291772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b388a32-33af-41a6-b55a-10913b489603 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.295027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 774/1552] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.296419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c12458-0021-4426-afb5-e9dc67d9e01d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.296713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c12458-0021-4426-afb5-e9dc67d9e01d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.296909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.297043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c12458-0021-4426-afb5-e9dc67d9e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.297605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.297896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.298266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.298941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.299996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:09:56.299996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:09:56.299996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:09:56.301646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.314751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-21c12458-0021-4426-afb5-e9dc67d9e01d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.315936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-21c12458-0021-4426-afb5-e9dc67d9e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.324387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 775/1553] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.325888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc918f-a74d-498f-b16e-c602c8277ba2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.326177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc918f-a74d-498f-b16e-c602c8277ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.326502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc918f-a74d-498f-b16e-c602c8277ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.333755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 779/1554] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.334864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.348375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0ecc918f-a74d-498f-b16e-c602c8277ba2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.349558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ecc918f-a74d-498f-b16e-c602c8277ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.396819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed9765-bd91-4dbb-a6b6-4eab984dad69 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.401556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e24aa-b2cf-4cda-8b5c-8fc08466c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.402210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e24aa-b2cf-4cda-8b5c-8fc08466c81e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.402522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e24aa-b2cf-4cda-8b5c-8fc08466c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.402800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e24aa-b2cf-4cda-8b5c-8fc08466c81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.403486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e24aa-b2cf-4cda-8b5c-8fc08466c81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.405396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e24aa-b2cf-4cda-8b5c-8fc08466c81e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.413098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 776/1555] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.414416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5653-d4a7-41fb-9d9d-be8d453b8aba None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.414709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5653-d4a7-41fb-9d9d-be8d453b8aba None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.414981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5653-d4a7-41fb-9d9d-be8d453b8aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.432107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 780/1556] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.433382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.433668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.433945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.434837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d89c5653-d4a7-41fb-9d9d-be8d453b8aba None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.436121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d89c5653-d4a7-41fb-9d9d-be8d453b8aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.451439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.452634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.494688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 777/1557] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.495967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6562a-8568-4df3-8824-02fd7eaea9ee None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.496255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6562a-8568-4df3-8824-02fd7eaea9ee None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.496530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6562a-8568-4df3-8824-02fd7eaea9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.513774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cbc6562a-8568-4df3-8824-02fd7eaea9ee None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.515049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cbc6562a-8568-4df3-8824-02fd7eaea9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.515185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 781/1558] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.519700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.523749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 778/1559] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.524936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.525254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.525531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.529363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a7e5b-f7e2-4895-a83b-77c0c251ab97 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.534083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.534762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.535609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.535892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.536584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.538547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.544026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:56.545205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:56.546798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:56.554415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 779/1560] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:56.558147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.564524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55edc8-5a8d-4431-9d73-c0cb3ed5222a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.572747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 782/1561] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.572913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.572913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.572913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.573215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.573305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.573305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.573305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:09:56.573305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:09:56.573305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:09:56.573818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.593753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 780/1562] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.594565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.603926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05cac-5558-44bd-9a03-4f0d924ff63c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.612282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:56.640485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70b58f-eaef-4131-92e5-9fd61ab34578 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.646092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.646784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.647069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.647349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.648079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.648384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.649997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.661784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 783/1563] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.662627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.669986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.670787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.671146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.671495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.672003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eecf2-ad1f-425d-9307-d04a921d3509 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.672327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.674306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.676494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.677112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.677392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.677664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.678426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.678729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.680303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.694175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 784/1564] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.694992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.696191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 781/1565] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.697039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.708040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd69b4e-ad67-4be0-8a9a-df4f8fe0543b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.712841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.713705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.714097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.714419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.714633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df138-d926-4ca5-bb58-a964c9e159e5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.715152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.715462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.717042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.719241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.719901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.720188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.720469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.721206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.721515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.723181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.744084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 782/1566] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.744084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.744388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 785/1567] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.744388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.746038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d88bb-78f4-47b9-881c-2e51b5d07e14 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.749986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566b302-d4b1-43bb-846e-69c37baf4e23 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.750942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.751580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.751888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.752175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.752862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.755257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.755398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.755909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.756192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.756469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.757198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:09:56.757503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.759108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.772581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 783/1568] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:09:56.773339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.782689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 786/1569] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.783085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3820fb-e0fc-4f8e-8fa8-76c31f8ff762 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.786526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.787665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.788306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.788591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.788867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.789585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.791217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.796127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8aea-c74c-4322-acc6-52fde82d4726 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.801122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.801754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.802042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.802354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.802698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 784/1570] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:56.803046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.804933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.806495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.817314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd84bf-38a3-457e-9059-76fc8350dc31 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.822873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.823690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.824036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.824316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.825180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.826888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.832684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 787/1571] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.833470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.841332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 785/1572] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:56.842210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.852799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2eafd-f1f7-4a95-9c6d-b07f10c7c0eb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.899141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64139324-4db1-4de7-831d-2c9c0caafed3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:56.904357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.905019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.905304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.905580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.906297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.908204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.912785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:56.913439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:56.913717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:56.913989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:56.914718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:56.916588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:56.933929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 788/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.935461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.942114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:56.946846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 786/1574] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:56.947665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:56.987287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:56.999892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9ca15-cf49-45ef-a905-3c4ed1819aa5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.011023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016459a-726b-4bd6-8a3e-98c5c278c361 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.015682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.016350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.016635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.016919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.017728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.020048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.049273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 787/1575] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.049273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.060045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.060718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.061004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.061283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.061980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.063930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.090052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 789/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:56 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.090932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.120198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830240b-187f-4ced-8af7-c9ba2db2a5f2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.153818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb749bb7-14f1-4be3-bef8-5bbb7709c3da admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.158460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.159124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.159408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.159683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.160461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.162070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.172182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 790/1577] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.173108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.179071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.179740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.180042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.180305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.181035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.182752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.185253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a125f3-1e81-4b9d-a1dc-5c735f3210e7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.190157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.190854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.191703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.192097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.192777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.196503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 788/1578] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.196503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.196977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.205890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9318c0-fa60-4d34-a3da-e7dbeaa567cb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.210732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.211415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.211701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.211982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.212706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.214295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.217037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 791/1579] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.217823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.226258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 789/1580] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.228666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.229815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169964d3-aa05-4fcb-ae3e-95cff4ab1d5e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.234720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.235386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.235675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.235958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.236642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.238889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa3b36-6260-40b5-9c25-8d93d4d29876 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.239391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.243519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.244156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.244440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.244717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.245430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.247562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.249760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:57.265285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 792/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.266561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.275287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 790/1582] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.276213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.279714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807b0e9-a0f5-4b35-be65-f9ff39ddae54 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.285703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.286534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.286877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.287209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.287927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359b29-1c4c-4e12-87b5-6d4783e59066 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.288037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.290696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.294419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.295300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.295729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.296108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.297217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.301228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.320193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 793/1583] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.321265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.326909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 791/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/users => generated 284 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:57.327603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.331492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71a06-eb49-46e8-bfbf-ec0c916eba45 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.336222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.337014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80a780-1981-4c2c-b4ee-b19378e6d843 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.337305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.337685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.338052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] PATH_INFO: `/v3/projects/f282215469e8463481d609437b9818a0/users/b9a1dadaad9b47299c666ef593bd5bec/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.341666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.342351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.342634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.342911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.343637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.345244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.354071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f282215469e8463481d609437b9818a0, user_id=b9a1dadaad9b47299c666ef593bd5bec, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.355295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:09:57.355295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:09:57.355295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:09:57.356234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 792/1585] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.357027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.357223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.370815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c95f-248c-4dd0-b9ac-09f8589b062d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.372644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 794/1586] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/f282215469e8463481d609437b9818a0/users/b9a1dadaad9b47299c666ef593bd5bec/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:57.373420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.377860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:57.431955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.433103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.433469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.433854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.434619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.435801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdd2ee-c98a-4b1a-8851-dd4176fc22c4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.436279 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.440460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.441349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.441635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.441921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] PATH_INFO: `/v3/projects/36045977efea463692997b9e7b75d6f8/users/6fb645f9d50449018a6e8a49e759acc1/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.446574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 793/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.447373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.456895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] RBAC: Authorizing `identity:create_grant(project_id=36045977efea463692997b9e7b75d6f8, user_id=6fb645f9d50449018a6e8a49e759acc1, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.457066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c32aa-3739-4d59-8620-4af23073bdd5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.459676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.461755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.462423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.462966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.462966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.463729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.465606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.473200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 795/1588] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/36045977efea463692997b9e7b75d6f8/users/6fb645f9d50449018a6e8a49e759acc1/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:57.473989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.479495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 794/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.479495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.489331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f738-6bb8-4bdf-95b1-2b43e94df2b2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.540824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41366730-eb72-4442-9d47-b14c2253debe admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.546086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.546790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.547075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.547430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.548027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.548169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.548704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.548989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.549267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.549667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.549998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.552281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.560323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 796/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.561011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.564686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 795/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.564686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.570677 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc7623-4343-4956-9569-e950c8afa687 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.572577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7646de-d665-43ad-aeae-a12745368d43 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.575488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6352d9-39fc-4f52-9f39-033b0951362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.576201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6352d9-39fc-4f52-9f39-033b0951362c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.576564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6352d9-39fc-4f52-9f39-033b0951362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.576850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6352d9-39fc-4f52-9f39-033b0951362c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.577275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.577573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6352d9-39fc-4f52-9f39-033b0951362c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.578135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.578462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.578742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] PATH_INFO: `/v3/projects/b5f46f954ca04440a7c1979e89e7402c/users/f2605e828fbd4ae690b7c2dbc0c4ce8b/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.579177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6352d9-39fc-4f52-9f39-033b0951362c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.590018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 797/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.590018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.590018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.590018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.596460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f46f954ca04440a7c1979e89e7402c, user_id=f2605e828fbd4ae690b7c2dbc0c4ce8b, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.599764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.609670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:57.610881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:57.612516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 796/1593] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/b5f46f954ca04440a7c1979e89e7402c/users/f2605e828fbd4ae690b7c2dbc0c4ce8b/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:57.613886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.636072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:57.682275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 798/1594] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:57.682726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef71917-78c8-4d67-b385-2996d9906647 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.682843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.689462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d2724-5851-49ec-a24e-8134a02a4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.690168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d2724-5851-49ec-a24e-8134a02a4491 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.690485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d2724-5851-49ec-a24e-8134a02a4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.690761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d2724-5851-49ec-a24e-8134a02a4491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.691352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0776b60-c649-4829-bfd3-a0024f046cc2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.691526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d2724-5851-49ec-a24e-8134a02a4491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.693115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d2724-5851-49ec-a24e-8134a02a4491 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.697493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.698300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.698593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.698877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.699606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.701199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.703440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 797/1595] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.704499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076003e-9923-4499-8fac-992641703b93 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.704787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076003e-9923-4499-8fac-992641703b93 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.705068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076003e-9923-4499-8fac-992641703b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.711102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:57.718363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 799/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.718363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.727104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42733118-87fe-4ce9-a753-c854bd5f8958 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.731892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.732624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.732911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.733191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.733907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.735526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.735638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5076003e-9923-4499-8fac-992641703b93 None None] MFA Rules not processed for user `6fb645f9d50449018a6e8a49e759acc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:57.736876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5076003e-9923-4499-8fac-992641703b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:57.745857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 800/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.746875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.756410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99956137-04df-4023-a15f-20cf03be273c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.761069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.761696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.761980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.762284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.762993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.764569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.775257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 801/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.776041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.785884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31440281-d4db-46ff-b4f3-48ab99f828a3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.790743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c301ef-e2bc-4cc5-ad7d-bf7789a549cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.791369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c301ef-e2bc-4cc5-ad7d-bf7789a549cd admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.791650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c301ef-e2bc-4cc5-ad7d-bf7789a549cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.791923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c301ef-e2bc-4cc5-ad7d-bf7789a549cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.792633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c301ef-e2bc-4cc5-ad7d-bf7789a549cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.794181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c301ef-e2bc-4cc5-ad7d-bf7789a549cd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.803917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 802/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:57.805102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.805393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.805674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.813827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 798/1600] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:57.813827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076003e-9923-4499-8fac-992641703b93 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.835713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] MFA Rules not processed for user `f2605e828fbd4ae690b7c2dbc0c4ce8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:57.837277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:57.869551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076003e-9923-4499-8fac-992641703b93 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.873422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.874441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.874804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.875164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.885532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.887045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.898502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 799/1601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:57.900781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.913830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 803/1602] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:57.914572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a98d4-2e0e-4ae1-b75e-3b2b2d1e4a47 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.915199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.922356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.924158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.924722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.925195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] PATH_INFO: `/v3/projects/bbc54f82f4584e7b9aed82c4a24d800f/users/817758e112e642398c6a837ef2edf4bb/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.927021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239af8-25a9-4474-ab9d-fc413b6ed1a4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:57.933164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:57.934019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:57.934337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:57.934617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] PATH_INFO: `/v3/projects/777141c138124398b085bda2d651e24f/users/445aaf8abb6445879918f530ac5c1303/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:57.943327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc54f82f4584e7b9aed82c4a24d800f, user_id=817758e112e642398c6a837ef2edf4bb, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.945990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.950604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777141c138124398b085bda2d651e24f, user_id=445aaf8abb6445879918f530ac5c1303, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:57.953993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:57.961633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 800/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/bbc54f82f4584e7b9aed82c4a24d800f/users/817758e112e642398c6a837ef2edf4bb/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:57.962620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:57.983317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 804/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/777141c138124398b085bda2d651e24f/users/445aaf8abb6445879918f530ac5c1303/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:57.984146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.044930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:58.056384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273ad24-ccf8-44f9-8b75-f4697b1624f3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.061587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.062530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.062810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.063132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] PATH_INFO: `/v3/projects/bf979f9956774d8d8ebfb346499ea877/users/2a3b9723e7cb460d87f264caf1476473/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.066996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4e05e-49ee-4957-9823-dd0c26c8ffa7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.071997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.072900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.073218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.073499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] PATH_INFO: `/v3/projects/d3f3b4fa4a714999ae4b23118e3b2659/users/05871256cf8848daab63a1a07f8b139b/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.079456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf979f9956774d8d8ebfb346499ea877, user_id=2a3b9723e7cb460d87f264caf1476473, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.082842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.085159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:58.094803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f3b4fa4a714999ae4b23118e3b2659, user_id=05871256cf8848daab63a1a07f8b139b, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.097836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.113670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 801/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/bf979f9956774d8d8ebfb346499ea877/users/2a3b9723e7cb460d87f264caf1476473/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:58.113670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.127995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 805/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:57 2022] PUT /identity/v3/projects/d3f3b4fa4a714999ae4b23118e3b2659/users/05871256cf8848daab63a1a07f8b139b/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:58.129454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.190702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff7cf8-4ce6-45f0-9014-61875d967b52 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.208970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feeae2-e3d3-4d52-83d7-cf632dd3f6f0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.213544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.214665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.214866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.215154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.215993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.219101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.260392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 806/1607] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:58.261920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.282106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22702822-3be0-461b-86b9-3d6fbe53184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.284033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22702822-3be0-461b-86b9-3d6fbe53184e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.284564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22702822-3be0-461b-86b9-3d6fbe53184e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.285068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22702822-3be0-461b-86b9-3d6fbe53184e admin admin] PATH_INFO: `/v3/projects/b5f3a2649f4f415d9025e5f71db12fbf/users/d08481f0180848c2b3c6a4c64b4d9058/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.303227 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22702822-3be0-461b-86b9-3d6fbe53184e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f3a2649f4f415d9025e5f71db12fbf, user_id=d08481f0180848c2b3c6a4c64b4d9058, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.306492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22702822-3be0-461b-86b9-3d6fbe53184e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.334962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 802/1608] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:58 2022] PUT /identity/v3/projects/b5f3a2649f4f415d9025e5f71db12fbf/users/d08481f0180848c2b3c6a4c64b4d9058/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:58.334962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8d5d6-8ce3-446b-a62e-1d15bb73bf5f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.334962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8d5d6-8ce3-446b-a62e-1d15bb73bf5f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.334962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8d5d6-8ce3-446b-a62e-1d15bb73bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.381388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c03271-6def-480d-b922-fa734d208096 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.381909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-45b8d5d6-8ce3-446b-a62e-1d15bb73bf5f None None] MFA Rules not processed for user `817758e112e642398c6a837ef2edf4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:58.383577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45b8d5d6-8ce3-446b-a62e-1d15bb73bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:58.450772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9799de-336c-48b4-b5b2-373fa5b2183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.451885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9799de-336c-48b4-b5b2-373fa5b2183c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.452368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9799de-336c-48b4-b5b2-373fa5b2183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.452751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9799de-336c-48b4-b5b2-373fa5b2183c admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.453639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9799de-336c-48b4-b5b2-373fa5b2183c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.455909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9799de-336c-48b4-b5b2-373fa5b2183c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.459141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:58.466193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 803/1609] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:58.467678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ed19-883d-4a79-bc24-0868834fd416 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.468034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ed19-883d-4a79-bc24-0868834fd416 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.468630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ed19-883d-4a79-bc24-0868834fd416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.491203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 807/1610] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:58.496148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.496719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.496905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.508390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2be5ed19-883d-4a79-bc24-0868834fd416 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:58.510062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2be5ed19-883d-4a79-bc24-0868834fd416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:58.520245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:58.531498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] MFA Rules not processed for user `2a3b9723e7cb460d87f264caf1476473`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:58.532829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:58.583277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 804/1611] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:58.584888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a09c-7283-4fea-bafe-f65c24ff8014 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.585247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a09c-7283-4fea-bafe-f65c24ff8014 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.585598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a09c-7283-4fea-bafe-f65c24ff8014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.618641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 808/1612] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:58.619631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.624928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-83c6a09c-7283-4fea-bafe-f65c24ff8014 None None] MFA Rules not processed for user `05871256cf8848daab63a1a07f8b139b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:58.630632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-83c6a09c-7283-4fea-bafe-f65c24ff8014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:58.634309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43848-14ef-4abd-bc3f-ecb87ae71e77 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.640549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c758-68b9-44fb-8539-5ab4fa4bc803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.641270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c758-68b9-44fb-8539-5ab4fa4bc803 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.641655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c758-68b9-44fb-8539-5ab4fa4bc803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.642038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c758-68b9-44fb-8539-5ab4fa4bc803 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.642884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347c758-68b9-44fb-8539-5ab4fa4bc803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.645938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347c758-68b9-44fb-8539-5ab4fa4bc803 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.677015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 809/1613] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:58.677015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.677015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.677015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.708054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] MFA Rules not processed for user `d08481f0180848c2b3c6a4c64b4d9058`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:58.709406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:58.734666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 805/1614] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:58.736229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6c7f4-af1b-40d7-a51a-3605f7bc69cb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.736527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6c7f4-af1b-40d7-a51a-3605f7bc69cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.736808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6c7f4-af1b-40d7-a51a-3605f7bc69cb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.742433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 806/1615] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 09:09:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:09:58.745249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6c7f4-af1b-40d7-a51a-3605f7bc69cb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.768192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6c7f4-af1b-40d7-a51a-3605f7bc69cb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.775882 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839b547-a1a3-4f6d-859b-76daf66f1306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.777552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839b547-a1a3-4f6d-859b-76daf66f1306 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.778014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839b547-a1a3-4f6d-859b-76daf66f1306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.778576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839b547-a1a3-4f6d-859b-76daf66f1306 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.779947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839b547-a1a3-4f6d-859b-76daf66f1306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.782505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839b547-a1a3-4f6d-859b-76daf66f1306 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.802668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 810/1616] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:58.807202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 807/1617] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:58.807930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.809301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334873-46e6-4681-b446-5a37faf83c3c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.809967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334873-46e6-4681-b446-5a37faf83c3c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.810298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334873-46e6-4681-b446-5a37faf83c3c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.812211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 808/1618] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jun 24 09:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:09:58.812951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334873-46e6-4681-b446-5a37faf83c3c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.826696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334873-46e6-4681-b446-5a37faf83c3c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.832252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.832924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.833213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.833492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.834266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.835866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.854042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 809/1619] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:58.855604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.875544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd5a6-d37a-49b9-86c5-86f4f36bd39a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.880913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abf2ae-95c1-42d1-a13f-875716e8a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.881584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf2ae-95c1-42d1-a13f-875716e8a534 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.881869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf2ae-95c1-42d1-a13f-875716e8a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.882206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf2ae-95c1-42d1-a13f-875716e8a534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.882953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abf2ae-95c1-42d1-a13f-875716e8a534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.884915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abf2ae-95c1-42d1-a13f-875716e8a534 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.893699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:58.900147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cfbb9-29cc-48f4-b2da-626dae6c3274 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.905320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:58.906271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.906710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.907195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.916269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 810/1620] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:58.917613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab3fe-512d-4c20-9831-1f6952be6888 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:58.917948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab3fe-512d-4c20-9831-1f6952be6888 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:58.918261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ab3fe-512d-4c20-9831-1f6952be6888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:58.919554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:58.921531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:58.933482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 811/1621] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:58.935202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:58.937870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8f8ab3fe-512d-4c20-9831-1f6952be6888 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:58.939474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f8ab3fe-512d-4c20-9831-1f6952be6888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:58.946057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db353dc5-e12e-4568-a5b0-b9102545206c service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:58.995908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:59.023704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 811/1622] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 09:09:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:59.025505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.026033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.026550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.042809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.043842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.044016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.044781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.045736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.048307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.053549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:59.065133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 812/1623] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:59.065133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.069852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:59.092224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 812/1624] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jun 24 09:09:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:59.093392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.105241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1211-17e7-4a20-9cb6-16b22d11d7d6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.116263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.117316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.118366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.118695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] PATH_INFO: `/v3/projects/9e2b00cb78c740e29203b69d914bc473/users/daae9df74565438d8f9a1efd3d723188/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.140190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53baef6-8808-4c04-8068-e3fb3e647394 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.143590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2b00cb78c740e29203b69d914bc473, user_id=daae9df74565438d8f9a1efd3d723188, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.147706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.148751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.150849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.151481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.152336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.168668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 813/1625] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:59 2022] PUT /identity/v3/projects/9e2b00cb78c740e29203b69d914bc473/users/daae9df74565438d8f9a1efd3d723188/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:59.172587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.244616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.246512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.251475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87f08b-06f5-4f98-80b0-8d5e9649140f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.257191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.257877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.258158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.258847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.259207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.261308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.262153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 813/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:59.263292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.291614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b44ca6-cc44-418e-a464-90c0e431d620 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.296143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 814/1627] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:09:59 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:09:59.300571 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.340025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57b068-2be9-4a27-a7f8-10de33da0b98 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.355475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.361798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.362187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.362694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] PATH_INFO: `/v3/projects/25e70261ca404750b70e4407f64bc315/users/991bd95c99c04e179207b844a342541f/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.384392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:59.390456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e70261ca404750b70e4407f64bc315, user_id=991bd95c99c04e179207b844a342541f, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.395919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.426208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 815/1628] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:59 2022] PUT /identity/v3/projects/25e70261ca404750b70e4407f64bc315/users/991bd95c99c04e179207b844a342541f/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:59.427229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.428191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.428939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.429400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.430336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.544751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.547575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.558981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df45a6-3dee-4c81-bff1-754b994f2d2a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.572165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 814/1629] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:59.572780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.574307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.574601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.574881 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.576631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.602447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4422e-0387-44f0-b545-ea487a06836a service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.607748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:59.735901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.737754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.770314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 816/1630] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:59.773130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.776811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.777510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.777801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.778084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.778879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.780507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.804490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f25563-e991-44d3-812f-cc7908e15c4c service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.811477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 815/1631] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:59.812311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.821421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.822130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.822442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.822725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.823864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.825637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.842717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772005f-d6da-4d1d-979d-8a6a56afd96d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.851119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 817/1632] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:59.853158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.859499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.860190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.860474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.860754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.861495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.863199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.872993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b63a4-44b5-47f1-ae90-b6e11265642c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.883558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 816/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:09:59.884535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.892677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.895289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.896462 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.896917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] PATH_INFO: `/v3/projects/9e2b00cb78c740e29203b69d914bc473/users/daae9df74565438d8f9a1efd3d723188/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.901816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2b00cb78c740e29203b69d914bc473, user_id=daae9df74565438d8f9a1efd3d723188, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.908573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:59.914519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1232a-f2df-48fc-837f-acf7961a894b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:59.930662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb4ca2-54cb-4e72-af0a-289ad6c3f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:59.931625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb4ca2-54cb-4e72-af0a-289ad6c3f9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:59.931942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb4ca2-54cb-4e72-af0a-289ad6c3f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:59.932219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb4ca2-54cb-4e72-af0a-289ad6c3f9c9 admin admin] PATH_INFO: `/v3/projects/3cffd40abfc44e7caf670ceab1a140c8/users/beeb6236913e466d9e75a6738e60420a/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:59.940681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 818/1634] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:59 2022] PUT /identity/v3/projects/9e2b00cb78c740e29203b69d914bc473/users/daae9df74565438d8f9a1efd3d723188/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:09:59.943552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:59.987798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb4ca2-54cb-4e72-af0a-289ad6c3f9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cffd40abfc44e7caf670ceab1a140c8, user_id=beeb6236913e466d9e75a6738e60420a, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:59.991637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb4ca2-54cb-4e72-af0a-289ad6c3f9c9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.073503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 817/1635] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:59 2022] PUT /identity/v3/projects/3cffd40abfc44e7caf670ceab1a140c8/users/beeb6236913e466d9e75a6738e60420a/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:00.073503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c8c1-7a0f-4247-97bc-e495b25d8e29 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.073503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c8c1-7a0f-4247-97bc-e495b25d8e29 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.073503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3c8c1-7a0f-4247-97bc-e495b25d8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.117132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9bf3c8c1-7a0f-4247-97bc-e495b25d8e29 None None] MFA Rules not processed for user `daae9df74565438d8f9a1efd3d723188`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:00.118422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9bf3c8c1-7a0f-4247-97bc-e495b25d8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:00.133745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7855d-b1e3-4979-b365-4aca0219d827 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:00.168997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:00.209707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa01b8-53de-43d3-8790-20187046ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:00.210650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa01b8-53de-43d3-8790-20187046ba7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.210938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa01b8-53de-43d3-8790-20187046ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.211221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa01b8-53de-43d3-8790-20187046ba7d admin admin] PATH_INFO: `/v3/projects/25e70261ca404750b70e4407f64bc315/users/991bd95c99c04e179207b844a342541f/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.213284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa01b8-53de-43d3-8790-20187046ba7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e70261ca404750b70e4407f64bc315, user_id=991bd95c99c04e179207b844a342541f, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:00.216594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa01b8-53de-43d3-8790-20187046ba7d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.236062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 819/1636] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:09:59 2022] PUT /identity/v3/projects/25e70261ca404750b70e4407f64bc315/users/991bd95c99c04e179207b844a342541f/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:00.236062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90d7b6-38af-4a31-8e95-f520057ba36b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.236062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90d7b6-38af-4a31-8e95-f520057ba36b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.236062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90d7b6-38af-4a31-8e95-f520057ba36b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.236062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 820/1637] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 09:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:00.236062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90d7b6-38af-4a31-8e95-f520057ba36b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:00.289726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 818/1638] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:00.291252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.293678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.294069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.296918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:00.329619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:00.330975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:00.335361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90d7b6-38af-4a31-8e95-f520057ba36b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:00.340440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb27409-68c4-4acb-8187-7b2a61e0a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:00.341338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27409-68c4-4acb-8187-7b2a61e0a3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.341701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27409-68c4-4acb-8187-7b2a61e0a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.342051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb27409-68c4-4acb-8187-7b2a61e0a3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.342923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27409-68c4-4acb-8187-7b2a61e0a3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:00.344607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb27409-68c4-4acb-8187-7b2a61e0a3e4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.382841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 821/1639] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:00.384377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.384668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.384952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.424134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 819/1640] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:00.426386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:00.460426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] MFA Rules not processed for user `991bd95c99c04e179207b844a342541f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:00.462672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:00.505862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64958487-da32-4500-8f1a-bf1ac8ba77f7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:00.510334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f3cf7-c793-4345-8400-4aa85d028f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:00.511227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3cf7-c793-4345-8400-4aa85d028f3c service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.511584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3cf7-c793-4345-8400-4aa85d028f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.511936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f3cf7-c793-4345-8400-4aa85d028f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.579128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 822/1641] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:00.579128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:00.593185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6f7f3-0186-4d08-bcaa-6022fb9f4217 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:00.598494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3cf7-c793-4345-8400-4aa85d028f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:00.599302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494d7aa-523f-4b27-9c0c-b1d9b7255d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:00.600225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f3cf7-c793-4345-8400-4aa85d028f3c service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.600343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d7aa-523f-4b27-9c0c-b1d9b7255d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.600802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d7aa-523f-4b27-9c0c-b1d9b7255d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.601149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d7aa-523f-4b27-9c0c-b1d9b7255d26 admin admin] PATH_INFO: `/v3/projects/3cffd40abfc44e7caf670ceab1a140c8/users/beeb6236913e466d9e75a6738e60420a/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.603275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494d7aa-523f-4b27-9c0c-b1d9b7255d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cffd40abfc44e7caf670ceab1a140c8, user_id=beeb6236913e466d9e75a6738e60420a, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:00.606736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494d7aa-523f-4b27-9c0c-b1d9b7255d26 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.611812 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 820/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:00.613945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ade8-21b4-413d-9274-77eb72100138 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.614812 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ade8-21b4-413d-9274-77eb72100138 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.614812 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1ade8-21b4-413d-9274-77eb72100138 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.616510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 821/1643] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 09:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:00.617573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ade8-21b4-413d-9274-77eb72100138 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:00.622765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 823/1644] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:00 2022] PUT /identity/v3/projects/3cffd40abfc44e7caf670ceab1a140c8/users/beeb6236913e466d9e75a6738e60420a/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:00.624010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41e68-ed36-46c0-9bdc-7a790e9eee85 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.624308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41e68-ed36-46c0-9bdc-7a790e9eee85 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.624808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d41e68-ed36-46c0-9bdc-7a790e9eee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.635054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:00.666716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-11d41e68-ed36-46c0-9bdc-7a790e9eee85 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:00.668739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-11d41e68-ed36-46c0-9bdc-7a790e9eee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:00.746823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1ade8-21b4-413d-9274-77eb72100138 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:00.753660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:00.754590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.755068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.755552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.760063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 824/1645] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:00.761661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.762042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.762762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.775035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:00.781630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.795843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 822/1646] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:00.797873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] MFA Rules not processed for user `beeb6236913e466d9e75a6738e60420a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:00.799147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:00.809586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:00.825095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:00.832987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc7b39-45bd-42cb-b9f4-100d22e163e7 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:00.841453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:00.842127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:00.844580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:00.845495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:00.910612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 825/1647] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:00.964689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:00.966204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:00.984223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 823/1648] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:01.153103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:01.169011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0dc18-727b-4e99-99bc-09b0a222a468 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:01.175424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:01.176684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:01.177036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:01.177377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:01.198111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:01.201634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:01.229181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 826/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:01.267440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:01.283737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e69eab-9361-48df-aeb1-31e0c74cc275 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:01.292230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:01.293209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:01.293842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:01.294332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:01.312535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:01.315958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:01.334147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 824/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:02.045439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:02.061923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816d4f-75bd-48b8-bcb7-2b3cf9471b3b service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:02.070677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:02.074319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:02.077108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:02.077108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:02.228995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:02.232486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:02.255292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 827/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:02.315758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:02.379386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:02.541034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4177dd3-447b-496f-b8cd-b0da18d327d3 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:02.559125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:02.560027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:02.560306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:02.562681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] PATH_INFO: `/v3/users/2a3b9723e7cb460d87f264caf1476473` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:02.564792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3b9723e7cb460d87f264caf1476473)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:02.576530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: WARNING py.warnings [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:10:02.576530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: warnings.warn(msg) Jun 24 09:10:02.576530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: Jun 24 09:10:02.577805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:02.613987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a7e42-f5cc-4c3d-9a84-5c31c1e58fc2 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:02.634164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae9df74565438d8f9a1efd3d723188', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e2b00cb78c740e29203b69d914bc473', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:02.635076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:02.638751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:02.639988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:02.641910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:02.642292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:02.647170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:02.689993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 828/1652] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:02.699575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:02.702279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:02.723380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dfd50-2cc6-4403-af4e-8c539b5cadd7 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:02.734638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae9df74565438d8f9a1efd3d723188', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e2b00cb78c740e29203b69d914bc473', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:02.735458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:02.736789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3b9723e7cb460d87f264caf1476473'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:02.739394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:02.742330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:02.745336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:02.747842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:02.764829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3b9723e7cb460d87f264caf1476473'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:02.772038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3b9723e7cb460d87f264caf1476473'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:02.773229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3b9723e7cb460d87f264caf1476473'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:02.827631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 829/1653] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:02 2022] POST /identity/v3/projects => generated 354 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:02.828961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:02.831242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c5043c8b-5fd7-4b2e-b398-6ef85d217215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3b9723e7cb460d87f264caf1476473'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:02.838621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:02.863687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 825/1654] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:02 2022] DELETE /identity/v3/users/2a3b9723e7cb460d87f264caf1476473 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:02.867819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:02.868323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:02.868754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:02.897566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:02.915426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:02.917411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:03.009006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5c36e-a6d7-447d-9c89-ace2c2ed90a3 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:03.079731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 826/1655] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:03.114634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:03.116547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:03.204501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae9df74565438d8f9a1efd3d723188', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e2b00cb78c740e29203b69d914bc473', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:03.205488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:03.208799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:03.209277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:03.210291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:03.214413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:03.222397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:03.265787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 830/1656] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:03.291275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca9d33-66cc-4c11-b065-b94801f24bd1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:03.304391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:03.304976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:03.305265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:03.305551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:03.320530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:03.322633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:03.349172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 827/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:03.554749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:03.574830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780cb35-2b3b-4d5b-ab34-78c91e5231aa tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:03.582431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae9df74565438d8f9a1efd3d723188', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e2b00cb78c740e29203b69d914bc473', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:03.583600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:03.584178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:03.584606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] PATH_INFO: `/v3/projects/35c1ee63d6784637b4d43fa00f354af8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:03.587838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35c1ee63d6784637b4d43fa00f354af8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:03.589941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:10:03.589941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: warnings.warn(msg) Jun 24 09:10:03.589941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: Jun 24 09:10:03.593942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:03.743274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c1ee63d6784637b4d43fa00f354af8', 'request_id': 'req-7f87e609-a6be-48d6-8220-6ea3f58def64'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:03.763068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c1ee63d6784637b4d43fa00f354af8', 'request_id': 'req-7f87e609-a6be-48d6-8220-6ea3f58def64'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:03.793117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c1ee63d6784637b4d43fa00f354af8', 'request_id': 'req-7f87e609-a6be-48d6-8220-6ea3f58def64'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:03.821840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] The token cache is being invalidate because project 35c1ee63d6784637b4d43fa00f354af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:03.822544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:03.823664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:03.835283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 831/1658] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:03 2022] DELETE /identity/v3/projects/35c1ee63d6784637b4d43fa00f354af8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:04.487281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:04.489810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:04.519783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb1738-43c6-4a0d-a0e9-d5d80c111e5b service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:04.525646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:04.527167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:04.641619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:04.674925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:04.676618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:04.681043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:04.682049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:04.682516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] PATH_INFO: `/v3/users/f2605e828fbd4ae690b7c2dbc0c4ce8b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:04.687827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2605e828fbd4ae690b7c2dbc0c4ce8b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:04.695599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:04.758117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87e609-a6be-48d6-8220-6ea3f58def64 tempest-VolumeQuotaClassesTest-1861652717 tempest-VolumeQuotaClassesTest-1861652717-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:04.774715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:04.777725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:04.778192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:04.778625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] PATH_INFO: `/v3/users/6fb645f9d50449018a6e8a49e759acc1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:04.783092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb645f9d50449018a6e8a49e759acc1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:04.792726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:04.850413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2605e828fbd4ae690b7c2dbc0c4ce8b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.866435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2605e828fbd4ae690b7c2dbc0c4ce8b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.868644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2605e828fbd4ae690b7c2dbc0c4ce8b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.869981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2605e828fbd4ae690b7c2dbc0c4ce8b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.907103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-db64a205-1af9-4bfe-b574-d7dd263f8e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2605e828fbd4ae690b7c2dbc0c4ce8b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.940196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 828/1659] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:04 2022] DELETE /identity/v3/users/f2605e828fbd4ae690b7c2dbc0c4ce8b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:04.942446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb645f9d50449018a6e8a49e759acc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.942982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:04.943419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:04.943843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:04.961823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb645f9d50449018a6e8a49e759acc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.964309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb645f9d50449018a6e8a49e759acc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.986482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:04.989257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:04.992183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb645f9d50449018a6e8a49e759acc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:04.992812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18461d63-1df9-4bf9-8100-7afca724b4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb645f9d50449018a6e8a49e759acc1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:05.043832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 832/1660] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:04 2022] DELETE /identity/v3/users/6fb645f9d50449018a6e8a49e759acc1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:05.049056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:05.049199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:05.049450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:05.086664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 829/1661] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:05.096696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:05.099041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:05.120708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:05.122849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:05.312942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 833/1662] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:05.319743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649839f-d0c0-441f-b0ed-87e44c22b265 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:05.324233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:05.446351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:05.530522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:05.531313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:05.531609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:05.531896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:05.541866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad5f1e-beb4-49d3-b631-e2093b5d0345 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:05.558152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc239ea0-7a7c-44fb-8a44-c9882908b170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:05.558899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc239ea0-7a7c-44fb-8a44-c9882908b170 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:05.559192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc239ea0-7a7c-44fb-8a44-c9882908b170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:05.559476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc239ea0-7a7c-44fb-8a44-c9882908b170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:05.562724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:05.569374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:05.604871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc239ea0-7a7c-44fb-8a44-c9882908b170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:05.612111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 830/1663] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:05.612111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:05.622394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc239ea0-7a7c-44fb-8a44-c9882908b170 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:05.634603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:05.664765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1cf79-86d9-4b4c-b3dc-60b62099b88e service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:05.675326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:05.677116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:05.679978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 834/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:05.680183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:05.680512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] PATH_INFO: `/v3/projects/bf979f9956774d8d8ebfb346499ea877` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:05.682249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf979f9956774d8d8ebfb346499ea877)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:05.684412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:05.804509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf979f9956774d8d8ebfb346499ea877', 'request_id': 'req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:05.813884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf979f9956774d8d8ebfb346499ea877', 'request_id': 'req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:05.826972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf979f9956774d8d8ebfb346499ea877', 'request_id': 'req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:05.845974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] The token cache is being invalidate because project bf979f9956774d8d8ebfb346499ea877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:05.846157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:05.847870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7dc03c7d-eec5-4ecd-95eb-3a3683f31be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:05.852956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 831/1665] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:05 2022] DELETE /identity/v3/projects/bf979f9956774d8d8ebfb346499ea877 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:05.856075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:05.857911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:05.858506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:05.874689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:05.904344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:05.905950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:06.103420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 835/1666] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:06.106875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.107277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.107560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.146729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:06.150001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:06.169718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.179727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 832/1667] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:06.191861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb23d6-e7e0-4333-b12d-01d0fe84333c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:06.199574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:06.201290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.201797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.202405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.203448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:06.203984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:06.206639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:06.228540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 836/1668] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:06.235646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.251742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6540bdc-d793-4fd0-a869-31cba9e7900c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:06.262497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:06.262497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.263465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.263851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.265531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:06.267030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:06.330820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 833/1669] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:06 2022] POST /identity/v3/projects => generated 403 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:06.332186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.352522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207ef8c-967c-4d29-8869-12c8647c3b3b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:06.470870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:06.472634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.472924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.473205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.474652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:06.477447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:06.517326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 837/1670] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:06 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:06.521546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.538825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7d6aa-ad4d-46aa-b551-bc7d1f869a28 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:06.554307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:06.555584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.556278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.562773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.564038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:06.567518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:06.590145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 834/1671] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:06.590294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.608199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be427703-9d98-4da6-a714-638bdddbee6c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:06.615392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b08be7-43ec-4d36-8331-7764a5a86dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:06.616377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08be7-43ec-4d36-8331-7764a5a86dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.618197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08be7-43ec-4d36-8331-7764a5a86dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.618667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08be7-43ec-4d36-8331-7764a5a86dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.619562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b08be7-43ec-4d36-8331-7764a5a86dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:06.621465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b08be7-43ec-4d36-8331-7764a5a86dbe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:06.636069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 838/1672] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:06.640786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.653287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e108a-7abd-4495-a796-3527ad8c88ed admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:06.662159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:06.664006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.664544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.665017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] PATH_INFO: `/v3/projects/a960067fefd8452fbd0b3f1244f375d7/users/217a7875fa7d4735a14312bf308fb10d/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.691732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a960067fefd8452fbd0b3f1244f375d7, user_id=217a7875fa7d4735a14312bf308fb10d, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:06.724790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:06.778895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 835/1673] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:06 2022] PUT /identity/v3/projects/a960067fefd8452fbd0b3f1244f375d7/users/217a7875fa7d4735a14312bf308fb10d/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:06.785020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:06.785308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:06.785743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:06.828091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:06.829887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:06.940729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 839/1674] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:06.982698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:06.984585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:07.145118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:07.153291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1c27f-845e-4823-8551-eb55ab539763 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:07.160306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0eead-9c7c-4363-8606-a08b0dab98dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:07.162010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0eead-9c7c-4363-8606-a08b0dab98dd service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:07.162676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0eead-9c7c-4363-8606-a08b0dab98dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:07.163231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0eead-9c7c-4363-8606-a08b0dab98dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:07.185831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:07.186680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:07.205697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0eead-9c7c-4363-8606-a08b0dab98dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:07.212958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0eead-9c7c-4363-8606-a08b0dab98dd service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:07.219503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163fc73-23cb-48ab-8730-a861249b6f08 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:07.248457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:07.249877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:07.250244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:07.250552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] PATH_INFO: `/v3/users/817758e112e642398c6a837ef2edf4bb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:07.256720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 836/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:07.257281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817758e112e642398c6a837ef2edf4bb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:07.261831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:07.276949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:07.442535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817758e112e642398c6a837ef2edf4bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:07.452970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817758e112e642398c6a837ef2edf4bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:07.454058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817758e112e642398c6a837ef2edf4bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:07.486471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817758e112e642398c6a837ef2edf4bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:07.487363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817758e112e642398c6a837ef2edf4bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:07.513970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 840/1676] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:07 2022] DELETE /identity/v3/users/817758e112e642398c6a837ef2edf4bb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:07.518513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:07.519166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:07.519729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:07.567374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:07.574787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:07.749100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 837/1677] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:07.888950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:07.890484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:07.892194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:07.894445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:07.957524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed615-6971-4fb8-a504-c316bc5fb053 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:07.977846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:07.979065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:07.981848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:07.982319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] PATH_INFO: `/v3/projects/b5f46f954ca04440a7c1979e89e7402c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:07.987139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f46f954ca04440a7c1979e89e7402c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:08.004549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:08.153378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34749d2-f1c9-4b85-bfaf-8aac6bbc5d03 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:08.192246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f46f954ca04440a7c1979e89e7402c', 'request_id': 'req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.224241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f46f954ca04440a7c1979e89e7402c', 'request_id': 'req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.251265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f46f954ca04440a7c1979e89e7402c', 'request_id': 'req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.273905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] The token cache is being invalidate because project b5f46f954ca04440a7c1979e89e7402c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:08.274478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.275306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b34a93a1-0949-4303-baa7-e9dd4fa4acf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.299111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 841/1678] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:07 2022] DELETE /identity/v3/projects/b5f46f954ca04440a7c1979e89e7402c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:08.299451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:08.299451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:08.299818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:08.329087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:08.329935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:08.330612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:08.331224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:08.348488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:08.410910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] MFA Rules not processed for user `b9a1dadaad9b47299c666ef593bd5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:08.413932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:08.559317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:08.567334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:08.582255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:08.600095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 838/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:08.601896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:08.604051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:08.608737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:08.633097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 842/1680] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:08.634166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:08.638719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88035-dce0-4406-8f8a-5fc6e5a73a7a service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:08.643504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:08.655279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:08.656530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:08.657103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:08.657939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] PATH_INFO: `/v3/projects/36045977efea463692997b9e7b75d6f8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:08.662680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36045977efea463692997b9e7b75d6f8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:08.664813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:08.679122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69f0a-7633-4954-9e83-559ae4c7fe7e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:08.703078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:08.709440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:08.709440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:08.709440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] PATH_INFO: `/v3/users/991bd95c99c04e179207b844a342541f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:08.717047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=991bd95c99c04e179207b844a342541f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:08.720217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:08.829737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36045977efea463692997b9e7b75d6f8', 'request_id': 'req-fa00cbf2-5289-4e07-9397-b1602d7e8371'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.851655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36045977efea463692997b9e7b75d6f8', 'request_id': 'req-fa00cbf2-5289-4e07-9397-b1602d7e8371'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.882883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36045977efea463692997b9e7b75d6f8', 'request_id': 'req-fa00cbf2-5289-4e07-9397-b1602d7e8371'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.884050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991bd95c99c04e179207b844a342541f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.904926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991bd95c99c04e179207b844a342541f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.907320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991bd95c99c04e179207b844a342541f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.921274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991bd95c99c04e179207b844a342541f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.922765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991bd95c99c04e179207b844a342541f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.927628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] The token cache is being invalidate because project 36045977efea463692997b9e7b75d6f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:08.927925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.933059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa00cbf2-5289-4e07-9397-b1602d7e8371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:08.938084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 839/1681] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:08 2022] DELETE /identity/v3/projects/36045977efea463692997b9e7b75d6f8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:08.939957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:08.943261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:08.945076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:08.956599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 843/1682] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:08 2022] DELETE /identity/v3/users/991bd95c99c04e179207b844a342541f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:08.959133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:08.961252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.016969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] MFA Rules not processed for user `b9a1dadaad9b47299c666ef593bd5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:09.022581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.114262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a82dc9-b043-4524-8846-690fc6c744bb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:09.127175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:09.129731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:09.130082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:09.139929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] PATH_INFO: `/v3/users/daae9df74565438d8f9a1efd3d723188` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:09.142636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daae9df74565438d8f9a1efd3d723188)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:09.145012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:09.191469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 840/1683] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:09.207778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:09.209983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.264050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daae9df74565438d8f9a1efd3d723188'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:09.283388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daae9df74565438d8f9a1efd3d723188'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:09.285615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daae9df74565438d8f9a1efd3d723188'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:09.298833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daae9df74565438d8f9a1efd3d723188'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:09.299257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ce9d0-d30e-46dc-9c8b-13137a8885a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daae9df74565438d8f9a1efd3d723188'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:09.309840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:09.343760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 844/1684] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:08 2022] DELETE /identity/v3/users/daae9df74565438d8f9a1efd3d723188 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:09.407261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf77942-95a7-4994-8cfc-51e8f26c0b9b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:09.469123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:09.473354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383de1-db10-46eb-92bb-4a77e066be04 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:09.473883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383de1-db10-46eb-92bb-4a77e066be04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:09.474356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383de1-db10-46eb-92bb-4a77e066be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:09.521302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b2383de1-db10-46eb-92bb-4a77e066be04 None None] MFA Rules not processed for user `445aaf8abb6445879918f530ac5c1303`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:09.526892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2383de1-db10-46eb-92bb-4a77e066be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.594608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:09.595889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:09.596367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:09.596783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:09.599987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.687754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 845/1685] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:09.699520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:09.700063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:09.700488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:09.729182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] MFA Rules not processed for user `445aaf8abb6445879918f530ac5c1303`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:09.732588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.755578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 846/1686] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:09.762871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:09.764516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:09.767638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:09.772886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:09.795350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b82e5-952c-4665-885f-a1d0712c3964 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:09.803665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 841/1687] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:09.807755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3de05a-2229-499a-8d14-f71dbb5c7c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:09.808808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3de05a-2229-499a-8d14-f71dbb5c7c08 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:09.809221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3de05a-2229-499a-8d14-f71dbb5c7c08 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:09.809648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3de05a-2229-499a-8d14-f71dbb5c7c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:09.830505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3de05a-2229-499a-8d14-f71dbb5c7c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:09.833706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3de05a-2229-499a-8d14-f71dbb5c7c08 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:09.856555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 847/1688] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:09.938236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:09.941862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:10.160728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b62b62-9fa3-4c4a-813a-ff8de59b85bf service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:10.184936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:10.185831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:10.186112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:10.186414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] PATH_INFO: `/v3/projects/bbc54f82f4584e7b9aed82c4a24d800f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:10.199551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc54f82f4584e7b9aed82c4a24d800f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:10.208307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:10.325441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6949-803f-4bfc-b59b-33bb19b11225 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:10.325975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6949-803f-4bfc-b59b-33bb19b11225 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:10.325975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c6949-803f-4bfc-b59b-33bb19b11225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:10.367261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc54f82f4584e7b9aed82c4a24d800f', 'request_id': 'req-d0cb49f4-b93c-4d18-90e7-29cfc9207233'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.387881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc54f82f4584e7b9aed82c4a24d800f', 'request_id': 'req-d0cb49f4-b93c-4d18-90e7-29cfc9207233'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.417426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc54f82f4584e7b9aed82c4a24d800f', 'request_id': 'req-d0cb49f4-b93c-4d18-90e7-29cfc9207233'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.422431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:10.435051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ed8c6949-803f-4bfc-b59b-33bb19b11225 None None] MFA Rules not processed for user `217a7875fa7d4735a14312bf308fb10d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:10.436292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed8c6949-803f-4bfc-b59b-33bb19b11225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:10.451791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] The token cache is being invalidate because project bbc54f82f4584e7b9aed82c4a24d800f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:10.451965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.453403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.463336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 842/1689] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:09 2022] DELETE /identity/v3/projects/bbc54f82f4584e7b9aed82c4a24d800f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:10.465487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:10.470864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:10.658904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 848/1690] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:10.661336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:10.662908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:10.663440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:10.677956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb49f4-b93c-4d18-90e7-29cfc9207233 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:10.690386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:10.692181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:10.693385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:10.693802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] PATH_INFO: `/v3/projects/25e70261ca404750b70e4407f64bc315` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:10.697719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e70261ca404750b70e4407f64bc315)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:10.702293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:10.716513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:10.721233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:10.755540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 849/1691] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:10.757718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:10.762815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:10.806936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e70261ca404750b70e4407f64bc315', 'request_id': 'req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.832186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e70261ca404750b70e4407f64bc315', 'request_id': 'req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.834704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e38-cce2-4c6a-8330-a2f535e3a16c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:10.853587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e70261ca404750b70e4407f64bc315', 'request_id': 'req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.885950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] The token cache is being invalidate because project 25e70261ca404750b70e4407f64bc315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:10.886456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.887250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:10.890025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 843/1692] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:10 2022] DELETE /identity/v3/projects/25e70261ca404750b70e4407f64bc315 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:10.891621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:10.896516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:10.943795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:11.001051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:11.002100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.002563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.003137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] PATH_INFO: `/v3/projects/9e2b00cb78c740e29203b69d914bc473` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.005519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2b00cb78c740e29203b69d914bc473)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:11.007999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:11.026328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0efe3f-b399-4c23-a416-0d1a8b8055a8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:11.039898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:11.041180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.041466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.041809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] PATH_INFO: `/v3/users/05871256cf8848daab63a1a07f8b139b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.044221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=05871256cf8848daab63a1a07f8b139b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:11.049666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:11.100460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2b00cb78c740e29203b69d914bc473', 'request_id': 'req-198b3040-cea7-4a55-9637-de8a68dca82e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.101114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:11.115415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2b00cb78c740e29203b69d914bc473', 'request_id': 'req-198b3040-cea7-4a55-9637-de8a68dca82e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.127572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2b00cb78c740e29203b69d914bc473', 'request_id': 'req-198b3040-cea7-4a55-9637-de8a68dca82e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.148977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05871256cf8848daab63a1a07f8b139b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.160620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] The token cache is being invalidate because project 9e2b00cb78c740e29203b69d914bc473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:11.160927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.162084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.164213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 850/1693] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:10 2022] DELETE /identity/v3/projects/9e2b00cb78c740e29203b69d914bc473 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:11.165142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:11.167113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05871256cf8848daab63a1a07f8b139b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.167882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05871256cf8848daab63a1a07f8b139b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.168615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05871256cf8848daab63a1a07f8b139b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.169669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.214213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7387e14c-ed20-4e43-b982-18e9e7e556fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05871256cf8848daab63a1a07f8b139b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:11.236671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 844/1694] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:10 2022] DELETE /identity/v3/users/05871256cf8848daab63a1a07f8b139b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:11.239103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd94ae-ff60-4f78-a272-16f217ac1361 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.239800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd94ae-ff60-4f78-a272-16f217ac1361 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.240363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd94ae-ff60-4f78-a272-16f217ac1361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.283351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-95cd94ae-ff60-4f78-a272-16f217ac1361 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.284660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-95cd94ae-ff60-4f78-a272-16f217ac1361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.294142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b3040-cea7-4a55-9637-de8a68dca82e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:11.371365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560cb36-2404-4f55-9db9-d7d3cd27cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:11.372193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560cb36-2404-4f55-9db9-d7d3cd27cdaf admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.372587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560cb36-2404-4f55-9db9-d7d3cd27cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.372973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560cb36-2404-4f55-9db9-d7d3cd27cdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.374345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560cb36-2404-4f55-9db9-d7d3cd27cdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:11.376665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560cb36-2404-4f55-9db9-d7d3cd27cdaf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:11.396310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 845/1695] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:11.397879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.398246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.398620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.415843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:11.435365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 851/1696] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/projects => generated 403 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:11.442212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944d6a-6106-4d36-99e8-49ee926d47ab None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.442557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944d6a-6106-4d36-99e8-49ee926d47ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.443468 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98944d6a-6106-4d36-99e8-49ee926d47ab None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.451725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 852/1697] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 09:10:11 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:11.453225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f644e-7e1b-4048-862d-bca5f4de63b8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.457165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f644e-7e1b-4048-862d-bca5f4de63b8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.458131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f644e-7e1b-4048-862d-bca5f4de63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.553815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3e9f644e-7e1b-4048-862d-bca5f4de63b8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.555413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3e9f644e-7e1b-4048-862d-bca5f4de63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.691247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 853/1698] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:11.691247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49e2e-844d-4a4b-b812-0ee905480400 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.691247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49e2e-844d-4a4b-b812-0ee905480400 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.691247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49e2e-844d-4a4b-b812-0ee905480400 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.695891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 854/1699] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jun 24 09:10:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:11.697616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.697863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.698148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.727722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.729434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.753507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 855/1700] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:11.754523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:11.786920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.788162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.792733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2481983-0ae8-440f-8c99-1f37cdf855fa None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:11.804765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:11.806579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.807022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 846/1701] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:11.807253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.807644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.807959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:11.812614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.812784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:11.813413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:11.817145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977fdb4-cd7c-46f6-84cb-856526800966 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:11.830307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659588-3699-4fdb-930f-8776aac8fc95 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:11.837446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7493aa-e12e-4eae-93b6-226b7bbd4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:11.839430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7493aa-e12e-4eae-93b6-226b7bbd4292 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.839773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 856/1702] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:11.840144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7493aa-e12e-4eae-93b6-226b7bbd4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.840144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7493aa-e12e-4eae-93b6-226b7bbd4292 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.841304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7493aa-e12e-4eae-93b6-226b7bbd4292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:11.841723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.841723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.841894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.850741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7493aa-e12e-4eae-93b6-226b7bbd4292 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:11.885793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 847/1703] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/users => generated 308 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:11.887451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470833-0640-4ce1-b80c-50d934b153b0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.887749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470833-0640-4ce1-b80c-50d934b153b0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.888033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2470833-0640-4ce1-b80c-50d934b153b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.902531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.904153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.911307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a2470833-0640-4ce1-b80c-50d934b153b0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.913880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2470833-0640-4ce1-b80c-50d934b153b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:11.928619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 848/1704] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:11.930688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193929c6-1f9b-4301-92a7-6a2cc5e1cc91 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:11.930992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193929c6-1f9b-4301-92a7-6a2cc5e1cc91 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:11.931366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193929c6-1f9b-4301-92a7-6a2cc5e1cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:11.959332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-193929c6-1f9b-4301-92a7-6a2cc5e1cc91 None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:11.963482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-193929c6-1f9b-4301-92a7-6a2cc5e1cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:12.022482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 857/1705] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:12.031221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.034962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:12.048161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 849/1706] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:10:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:12.049010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa62972-3912-4879-b35c-a475133a68b1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.052995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.053518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.054000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.054136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.054862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.055261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.055638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.066372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.067801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.077718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 858/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:12.078543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.079835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:12.081078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:12.088567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b1495-b2f1-43da-863d-e052843e7b71 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.089706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 850/1708] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:12.090452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.093456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.094146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.094517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.094840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.095481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.097406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.100274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3efd-82fb-4e05-9e35-700db3018e5a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.105083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.105750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.106285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.106393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.107227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.108850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.121609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 851/1709] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:12.125268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.134605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:12.139005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 859/1710] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:12.139922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.142193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d5900-cb35-465a-896b-0a8289a4ba6e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.204305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:12.220498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05365c9a-5e62-4255-9f3d-22c314cfbd8e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.224373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.224997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.225281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.225611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.227053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.227727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.228412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.228412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.229015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:12.229459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.231495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.233696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.235186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.247958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 860/1711] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:12.248624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 852/1712] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:12.248990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.249560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.257970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e5521-26b4-4a90-8605-1530b2fa3749 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.261324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632cb2e-ddca-4486-a272-1db1ba63d624 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.262314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.262960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.263296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.263601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.266653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.267428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.267927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.268308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.269349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:12.269728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.271541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.272111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.273142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.288226 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 861/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:12.289986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.295238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 853/1714] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:12.296334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.308994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5217e-8dc2-43cb-8027-b06818126a6e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.315325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c77ec5-df55-4cb4-86a2-3f4fa099afc4 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.315916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.316806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.317513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.317513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.318610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.321618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.323635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.324702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.325129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.325585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] PATH_INFO: `/v3/projects/a9b81972648d443ba3c50c721525a12f/users/aa80e2d386e347c593bff7e3bf053f31/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.350750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b81972648d443ba3c50c721525a12f, user_id=aa80e2d386e347c593bff7e3bf053f31, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.355508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.362465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 854/1715] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/users => generated 287 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:12.364506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.377260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 862/1716] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:12 2022] PUT /identity/v3/projects/a9b81972648d443ba3c50c721525a12f/users/aa80e2d386e347c593bff7e3bf053f31/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:12.381726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.389236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32875f12-789b-4f71-8103-fb313d314073 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.477414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.477624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.478165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.478582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.479676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.482122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.514932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 855/1717] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:12.516446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.521191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873c25-a769-4fb6-a105-a822ea351cd1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.591861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:12.597854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.598731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.599031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.599312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.600036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.602031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.606288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1d89-ee2b-4197-86a4-449da5352ace admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.612203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.613765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.614529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.615113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.616245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.618391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.632975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 856/1718] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:12.634382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.640875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 863/1719] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/projects => generated 367 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:12.641748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.643439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:12.650714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff4ce1-5664-4244-8f15-7ebbaecc4c71 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.695211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:12.733036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.734010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.734010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.734304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.735038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.737443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.739935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834cd29-f632-4afc-a25b-f0c37a71070c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.747431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.748649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.749301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.749747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] PATH_INFO: `/v3/projects/d3f3b4fa4a714999ae4b23118e3b2659` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.750457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 857/1720] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:12.751489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.754250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f3b4fa4a714999ae4b23118e3b2659)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.756425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.764661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d794d6-fd4f-46f8-8868-c3fc13b371fb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.771060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.772037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.772328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.772605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.773313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.775535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.812935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 858/1721] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:12.814101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.828692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d165f-6f01-450c-8b23-5a6c143ed3dd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.832520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f3b4fa4a714999ae4b23118e3b2659', 'request_id': 'req-e317c182-2836-46d5-9246-86853fb9358a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:12.845415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f3b4fa4a714999ae4b23118e3b2659', 'request_id': 'req-e317c182-2836-46d5-9246-86853fb9358a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:12.854078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f3b4fa4a714999ae4b23118e3b2659', 'request_id': 'req-e317c182-2836-46d5-9246-86853fb9358a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:12.876320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] The token cache is being invalidate because project d3f3b4fa4a714999ae4b23118e3b2659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:12.876785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:12.877582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:12.881759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 864/1722] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:12 2022] DELETE /identity/v3/projects/d3f3b4fa4a714999ae4b23118e3b2659 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:12.883363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.888813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:12.923956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.924797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.925226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.925604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.926515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.928242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:12.950628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 859/1723] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:12.951512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:12.958392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:12.981777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b66286-cf4d-4d65-880a-cc5f30484f30 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:12.989773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:12.990735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:12.991011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:12.991278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] PATH_INFO: `/v3/users/d08481f0180848c2b3c6a4c64b4d9058` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:12.992549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08481f0180848c2b3c6a4c64b4d9058)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:12.994704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.027118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317c182-2836-46d5-9246-86853fb9358a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.035222 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.036340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.036822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.037344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.039135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:13.041985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.077160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 865/1724] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:12 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:13.078451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:13.086495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.101528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3076f-0150-40f7-919a-208ebff2d244 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.113893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.116641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08481f0180848c2b3c6a4c64b4d9058'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.117770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.118482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.118961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] PATH_INFO: `/v3/projects/a9b81972648d443ba3c50c721525a12f/users/aa80e2d386e347c593bff7e3bf053f31/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.125301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b81972648d443ba3c50c721525a12f, user_id=aa80e2d386e347c593bff7e3bf053f31, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:13.133687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.146496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 866/1725] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:13 2022] PUT /identity/v3/projects/a9b81972648d443ba3c50c721525a12f/users/aa80e2d386e347c593bff7e3bf053f31/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:13.146496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:13.159651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08481f0180848c2b3c6a4c64b4d9058'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.160873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.163376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08481f0180848c2b3c6a4c64b4d9058'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.164640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08481f0180848c2b3c6a4c64b4d9058'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.166730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:13.205981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08481f0180848c2b3c6a4c64b4d9058'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.248552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 860/1726] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:12 2022] DELETE /identity/v3/users/d08481f0180848c2b3c6a4c64b4d9058 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:13.252067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:13.257317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.338269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:13.370800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd8d6-8311-4ead-a530-face19cdde1f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.454215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a0f21-9a93-49e5-a14a-f1031a21e062 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.460965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.461917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.462146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.462462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] PATH_INFO: `/v3/users/beeb6236913e466d9e75a6738e60420a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.466168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beeb6236913e466d9e75a6738e60420a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:13.470418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.504907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.505598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.505880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.506155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.506931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:13.508542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.529213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 867/1727] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:13.530167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:13.533385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.551621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebe929-7b3a-450b-87f8-2938ed4e32a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.553329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beeb6236913e466d9e75a6738e60420a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.556511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.557732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.558114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.558530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] PATH_INFO: `/v3/projects/cf8369aaec054cfe95b7cb9d0b5b4c13/users/c7ad1357e4fd4004af115616f8e087a7/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.562822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beeb6236913e466d9e75a6738e60420a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.563540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beeb6236913e466d9e75a6738e60420a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.564437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beeb6236913e466d9e75a6738e60420a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.584461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8369aaec054cfe95b7cb9d0b5b4c13, user_id=c7ad1357e4fd4004af115616f8e087a7, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:13.587328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.598743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dce9a693-db0a-4fb6-9009-a46e9743ab53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beeb6236913e466d9e75a6738e60420a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:13.607743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 868/1728] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:13 2022] PUT /identity/v3/projects/cf8369aaec054cfe95b7cb9d0b5b4c13/users/c7ad1357e4fd4004af115616f8e087a7/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:13.608974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:13.611004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.630013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 861/1729] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:13 2022] DELETE /identity/v3/users/beeb6236913e466d9e75a6738e60420a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:13.631859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07d09d-ce83-472c-9337-56d333a6f1b8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.632152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07d09d-ce83-472c-9337-56d333a6f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.632546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07d09d-ce83-472c-9337-56d333a6f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.705913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af2e9-6b5f-4071-9718-55c67fadd3ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.707012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ea07d09d-ce83-472c-9337-56d333a6f1b8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:13.713337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ea07d09d-ce83-472c-9337-56d333a6f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.833879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19be89-469f-4321-a9ae-03004d5ea691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.834730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19be89-469f-4321-a9ae-03004d5ea691 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.834876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19be89-469f-4321-a9ae-03004d5ea691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.835156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19be89-469f-4321-a9ae-03004d5ea691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.836444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19be89-469f-4321-a9ae-03004d5ea691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:13.838844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19be89-469f-4321-a9ae-03004d5ea691 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:13.853764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 869/1730] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:13.854924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:13.855394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494327bb-7716-4ba3-85d9-38ba13e9574b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.855527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494327bb-7716-4ba3-85d9-38ba13e9574b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.855887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494327bb-7716-4ba3-85d9-38ba13e9574b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.864867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 870/1731] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jun 24 09:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:13.865836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494327bb-7716-4ba3-85d9-38ba13e9574b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:13.867783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-494327bb-7716-4ba3-85d9-38ba13e9574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.883199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 862/1732] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:13.885208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065bcd-02cf-4565-ad61-70e7c8c1fc77 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.885834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065bcd-02cf-4565-ad61-70e7c8c1fc77 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.888551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065bcd-02cf-4565-ad61-70e7c8c1fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.898989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:13.936664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-39065bcd-02cf-4565-ad61-70e7c8c1fc77 None None] MFA Rules not processed for user `b9a1dadaad9b47299c666ef593bd5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:13.937905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-39065bcd-02cf-4565-ad61-70e7c8c1fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:13.983073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494327bb-7716-4ba3-85d9-38ba13e9574b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:13.991647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:13.992330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:13.992615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:13.993171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:13.996817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:14.012120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.013767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.036835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 871/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:14.038006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.039496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:14.053515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 863/1734] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:14.053515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.053515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.053515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.075865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb56866-1516-4b5b-8ccd-96b670998e4f service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.091755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.092418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.092704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.092979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.093766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.097223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.100817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] MFA Rules not processed for user `c7ad1357e4fd4004af115616f8e087a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:14.104027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:14.120917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 872/1735] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:14.125584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.150318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c8c1f-3c9f-4178-b62a-498e496e4143 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.161027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e658980-2741-4b91-976d-01cc4d6ac9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.161800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e658980-2741-4b91-976d-01cc4d6ac9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.162884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e658980-2741-4b91-976d-01cc4d6ac9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.162884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e658980-2741-4b91-976d-01cc4d6ac9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.163084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e658980-2741-4b91-976d-01cc4d6ac9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.170763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e658980-2741-4b91-976d-01cc4d6ac9d0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.210022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 873/1736] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:14.210022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.210022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.210022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.255936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:14.257389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:14.276853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 874/1737] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jun 24 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:14.277701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.278207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 864/1738] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:14.281569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.291293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:14.297909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaf9ad-dbcb-46d1-9755-83144753fabd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.308377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.311193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.311792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.313543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] PATH_INFO: `/v3/projects/9e240bdde7a34af58a0f1531b2884a88/users/28cf7ff250534e42a6a79a96fa8fd16e/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.338944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e240bdde7a34af58a0f1531b2884a88, user_id=28cf7ff250534e42a6a79a96fa8fd16e, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.342434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.368354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 865/1739] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:14 2022] PUT /identity/v3/projects/9e240bdde7a34af58a0f1531b2884a88/users/28cf7ff250534e42a6a79a96fa8fd16e/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:14.369354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.453784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130fd5-e2c6-4e11-a3e8-54787df0615d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.535404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012952c-a642-4e8a-93fb-fff0ea600d75 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.546880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.549166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.549473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.549760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] PATH_INFO: `/v3/projects/34de8f9ff85e4056b08a8699fed34947/users/96741a4f7328493aa12c5755394f100f/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.554467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.555288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.555711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.556561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.571596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.573107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.576132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:14.588731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 875/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:14.589954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.598033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34de8f9ff85e4056b08a8699fed34947, user_id=96741a4f7328493aa12c5755394f100f, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.605678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.637048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 866/1741] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:14 2022] PUT /identity/v3/projects/34de8f9ff85e4056b08a8699fed34947/users/96741a4f7328493aa12c5755394f100f/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:14.637927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:14.640623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:14.648193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:14.747520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa020d-544b-4ad3-a659-7684b38288a5 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.823595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b7162-3d15-4432-9ce0-14c933665674 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:14.834011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabaa17-eaf9-4696-8712-e4bbeea69a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.838785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabaa17-eaf9-4696-8712-e4bbeea69a8e service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.839461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabaa17-eaf9-4696-8712-e4bbeea69a8e service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.840071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabaa17-eaf9-4696-8712-e4bbeea69a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.897964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a9302-f122-477f-af5a-0503fd720c21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:14.898756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9302-f122-477f-af5a-0503fd720c21 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.899043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9302-f122-477f-af5a-0503fd720c21 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.899328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9302-f122-477f-af5a-0503fd720c21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.931191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a9302-f122-477f-af5a-0503fd720c21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.932857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a9302-f122-477f-af5a-0503fd720c21 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:14.951083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 876/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:14.963829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df941a8-cfc5-4206-8eb0-a6d520116e59 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:14.964118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df941a8-cfc5-4206-8eb0-a6d520116e59 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:14.964443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df941a8-cfc5-4206-8eb0-a6d520116e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:14.981163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabaa17-eaf9-4696-8712-e4bbeea69a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:14.983103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabaa17-eaf9-4696-8712-e4bbeea69a8e service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:15.006291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 867/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:15.007878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:15.012231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:15.020629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:15.060819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6df941a8-cfc5-4206-8eb0-a6d520116e59 None None] MFA Rules not processed for user `28cf7ff250534e42a6a79a96fa8fd16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:15.062318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6df941a8-cfc5-4206-8eb0-a6d520116e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:15.084499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] MFA Rules not processed for user `96741a4f7328493aa12c5755394f100f`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:15.088799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:15.225009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 868/1744] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:15.226340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:15.233332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:15.286871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:15.298861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 877/1745] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:15.301857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:15.302421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:15.302956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:15.357707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] MFA Rules not processed for user `aa80e2d386e347c593bff7e3bf053f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:15.359445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:15.421287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:15.455870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f56a31-3c01-4a6b-9c24-730207ac7c18 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:15.462658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 878/1746] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:15.464110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:15.473167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:15.475826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:15.476219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:15.478132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] PATH_INFO: `/v3/projects/3cffd40abfc44e7caf670ceab1a140c8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:15.482465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cffd40abfc44e7caf670ceab1a140c8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:15.491027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:15.498986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ada536-c602-4006-b6e6-7e265cfd0b22 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:15.516939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:15.519004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:15.519427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:15.520299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:15.522475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:15.526174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:15.627985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 879/1747] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:15 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:15.630147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:15.725191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cffd40abfc44e7caf670ceab1a140c8', 'request_id': 'req-7063f5e9-f7d5-4442-8b65-83e221774ce4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:15.747855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cffd40abfc44e7caf670ceab1a140c8', 'request_id': 'req-7063f5e9-f7d5-4442-8b65-83e221774ce4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:15.772330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cffd40abfc44e7caf670ceab1a140c8', 'request_id': 'req-7063f5e9-f7d5-4442-8b65-83e221774ce4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:15.812954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] The token cache is being invalidate because project 3cffd40abfc44e7caf670ceab1a140c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:15.813404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:15.814544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:15.827277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 869/1748] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:15 2022] DELETE /identity/v3/projects/3cffd40abfc44e7caf670ceab1a140c8 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:15.832186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:15.835832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:15.854642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8827-93eb-437e-994f-c3a2e0efd751 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:15.976542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:15.977483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:15.977901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:15.978529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:15.979625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:15.987110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.047770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 880/1749] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:15 2022] POST /identity/v3/projects => generated 385 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:16.050856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.057205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.067640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063f5e9-f7d5-4442-8b65-83e221774ce4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.157577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:16.210312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8246-f7ad-4ce3-9b14-8e9a085af407 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.227954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80f473-4664-44eb-9d7c-d8ce3a923709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.229958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f473-4664-44eb-9d7c-d8ce3a923709 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.231085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f473-4664-44eb-9d7c-d8ce3a923709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.231386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80f473-4664-44eb-9d7c-d8ce3a923709 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.233966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f473-4664-44eb-9d7c-d8ce3a923709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.241800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80f473-4664-44eb-9d7c-d8ce3a923709 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.280443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:16.290417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 881/1750] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:16 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:16.297994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.299340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.299743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.308336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.313256 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.316350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.316734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] PATH_INFO: `/v3/projects/b5f3a2649f4f415d9025e5f71db12fbf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.320270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f3a2649f4f415d9025e5f71db12fbf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.330099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.345218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:16.349070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.367788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 882/1751] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:16.369714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.376223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.395172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269f84-4b3f-401c-8aaf-b8a3ba44575e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.402494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.403284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.403642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.404004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.404734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.407002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.444311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 883/1752] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:16 2022] POST /identity/v3/users => generated 299 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:16.445637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.459781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf753c9e-230f-4d28-b1af-3c6c73a9c62b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.475866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f3a2649f4f415d9025e5f71db12fbf', 'request_id': 'req-b9e40405-ae5c-4847-93fa-5c9ed0765975'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:16.486072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f3a2649f4f415d9025e5f71db12fbf', 'request_id': 'req-b9e40405-ae5c-4847-93fa-5c9ed0765975'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:16.498499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f3a2649f4f415d9025e5f71db12fbf', 'request_id': 'req-b9e40405-ae5c-4847-93fa-5c9ed0765975'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:16.522262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] The token cache is being invalidate because project b5f3a2649f4f415d9025e5f71db12fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:16.522578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:16.523309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b9e40405-ae5c-4847-93fa-5c9ed0765975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:16.526520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 870/1753] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:15 2022] DELETE /identity/v3/projects/b5f3a2649f4f415d9025e5f71db12fbf => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:16.528026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219720-b79c-4e26-8f3d-ea5527d570e4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.528325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219720-b79c-4e26-8f3d-ea5527d570e4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.528603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20219720-b79c-4e26-8f3d-ea5527d570e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.552754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-20219720-b79c-4e26-8f3d-ea5527d570e4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:16.554114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-20219720-b79c-4e26-8f3d-ea5527d570e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.593683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.594602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.595485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.596053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.597808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.600581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.618782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 884/1754] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:16.620580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.623423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.636460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 871/1755] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:16.638270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.638478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59851810-7738-4611-8b51-35845eda6c1a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.639432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.640169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.644843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.645615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.645966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.646340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.647966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.649775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.671927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 885/1756] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:16.671927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.674768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.698804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61c4d-13a0-414e-978b-b70a6b1edc99 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.705358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.706832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.707114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.707390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] PATH_INFO: `/v3/projects/780f10a21bd64040bba6782ac3c4b490/users/dd2917561e314c8aabe7e0564a02614e/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.713912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:16.730495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:16.750703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780f10a21bd64040bba6782ac3c4b490, user_id=dd2917561e314c8aabe7e0564a02614e, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.753945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.765777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 872/1757] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:16.770959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.791861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 886/1758] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:16 2022] PUT /identity/v3/projects/780f10a21bd64040bba6782ac3c4b490/users/dd2917561e314c8aabe7e0564a02614e/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:16.792879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:16.807461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec8878-25b9-4dae-9a4f-8fb9177780d4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:16.939827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:16.940919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:16.941314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:16.941702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:16.942662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:16.947936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:16.949698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d39eb-919f-4ec0-bc09-e933a1542985 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:16.986426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a606-665a-46bc-81a0-3f068b2eb1c7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.003046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 873/1759] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:17.006988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.007175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.007598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.007890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.008609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.008609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] PATH_INFO: `/v3/projects/6f6513ea887c42f8824702e9255e96fc/users/a905310ade014f15a802e2ca459572fc/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.009000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.056213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6513ea887c42f8824702e9255e96fc, user_id=a905310ade014f15a802e2ca459572fc, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.058590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.068049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:17.084462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:17.088773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 887/1760] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:16 2022] PUT /identity/v3/projects/6f6513ea887c42f8824702e9255e96fc/users/a905310ade014f15a802e2ca459572fc/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:17.089853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.092823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:17.113727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:17.240721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 874/1761] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:17.244637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.265741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9558-c482-449d-9cf7-890f83d1a500 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.285390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660f2d-1ca1-496e-86a2-424a028aa7ff None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.292645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.293076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.293453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.293735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.294670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.296075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.300622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.303098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.303363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.303653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.305746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.310797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.332504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 888/1762] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:17.333284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.353067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb32c3-524d-424a-ab82-cb856c07cc6f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.374865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 875/1763] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:17 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:17.377715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.402264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.403726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.404029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.404525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.424389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.433657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.481435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 889/1764] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:17.481435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.497651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d78070-f360-40d9-98a6-936e85d3735e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.506214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.507315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.508425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.508663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] PATH_INFO: `/v3/projects/780f10a21bd64040bba6782ac3c4b490/users/dd2917561e314c8aabe7e0564a02614e/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.511049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780f10a21bd64040bba6782ac3c4b490, user_id=dd2917561e314c8aabe7e0564a02614e, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.514104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.516784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc59eb6-17cf-401b-8812-ee4f437de57b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.532791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 890/1765] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:17 2022] PUT /identity/v3/projects/780f10a21bd64040bba6782ac3c4b490/users/dd2917561e314c8aabe7e0564a02614e/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:17.534340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.548751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.549413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.549712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.551740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.552527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:17.554326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.559035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.594425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 876/1766] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:17.595551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:17.609067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5df245-2d8a-4b19-9ec2-084574d630ce admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.724744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc7c3-4aef-4902-91c9-a76b4ddb25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.726253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc7c3-4aef-4902-91c9-a76b4ddb25a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.726799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc7c3-4aef-4902-91c9-a76b4ddb25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.727226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc7c3-4aef-4902-91c9-a76b4ddb25a9 admin admin] PATH_INFO: `/v3/projects/6f6513ea887c42f8824702e9255e96fc/users/a905310ade014f15a802e2ca459572fc/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.734461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bc7c3-4aef-4902-91c9-a76b4ddb25a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6513ea887c42f8824702e9255e96fc, user_id=a905310ade014f15a802e2ca459572fc, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.740271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bc7c3-4aef-4902-91c9-a76b4ddb25a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:17.776448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 877/1767] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:17 2022] PUT /identity/v3/projects/6f6513ea887c42f8824702e9255e96fc/users/a905310ade014f15a802e2ca459572fc/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:17.778127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9361c-1f52-4202-8b99-b87d7be49e52 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.778480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9361c-1f52-4202-8b99-b87d7be49e52 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.778757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9361c-1f52-4202-8b99-b87d7be49e52 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.786759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 878/1768] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:10:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:17.788498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.788815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.789111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.811980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4493d3-7aa5-46de-9e83-df81988a7382 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:17.853299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] MFA Rules not processed for user `dd2917561e314c8aabe7e0564a02614e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:17.854796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:17.859811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:17.979769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b42a6-28ab-4af5-ae35-64c0c2227d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:17.980522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b42a6-28ab-4af5-ae35-64c0c2227d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:17.980811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b42a6-28ab-4af5-ae35-64c0c2227d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:17.981090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b42a6-28ab-4af5-ae35-64c0c2227d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:17.981798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b42a6-28ab-4af5-ae35-64c0c2227d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:17.983808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b42a6-28ab-4af5-ae35-64c0c2227d5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.023797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 879/1769] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:18.024807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.046913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 891/1770] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:17 2022] POST /identity/v3/users => generated 279 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:18.051921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2b24-de32-4611-8a0f-c589185ef43e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.052323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2b24-de32-4611-8a0f-c589185ef43e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.052776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b2b24-de32-4611-8a0f-c589185ef43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.060201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:18.070090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86f89f-2629-49b6-9d06-8334c9d6e300 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.082976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a240-5d72-471e-8055-e4dad7c1729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.088037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aa1b2b24-de32-4611-8a0f-c589185ef43e None None] MFA Rules not processed for user `a905310ade014f15a802e2ca459572fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:18.089578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aa1b2b24-de32-4611-8a0f-c589185ef43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.090183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a240-5d72-471e-8055-e4dad7c1729d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.091018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a240-5d72-471e-8055-e4dad7c1729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.091469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a240-5d72-471e-8055-e4dad7c1729d admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.093878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a240-5d72-471e-8055-e4dad7c1729d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.098380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a240-5d72-471e-8055-e4dad7c1729d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.161962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 880/1771] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:18 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:18.165049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.165552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.166750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.218447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:18.225152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.235877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 892/1772] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:18.238167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.238601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.238986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.266040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:18.269524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.424433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 893/1773] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:18.429138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 881/1774] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:18.429953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.432459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.435801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.580618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ff0f-ba39-4cce-a8b8-188d7a9cdb71 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.585939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.586792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.587194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.587640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.661037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:18.682290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.684242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.685963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4daf6-7428-422c-a826-f5978d409242 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.692779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.693546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.693911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.694559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.695394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.697347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.699046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 894/1775] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:18.699939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.713830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812c69d-d8a0-44b0-a408-fdc912be32f1 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.730704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.731505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.731924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 882/1776] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:18.732842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.733893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.734343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.736155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.736288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.740106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.770768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edd1cf-05d8-4fd5-8016-d3f835a98361 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.781910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 895/1777] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:18 2022] POST /identity/v3/users => generated 302 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:18.784006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.785930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.787134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.787811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.788122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.788402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.807881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:18.808606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06778-7bc4-4188-b5f3-fe97ab34358d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.828424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.829277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.829700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.830116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.840241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.842000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.852961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 896/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:18.853943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.855427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.877259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.879346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.890946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 883/1779] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:18.891836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.902757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe54ad-0662-4f89-bfe8-1433d93a8750 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.907748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.908433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.908719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.909002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.909784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.911429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.922869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 884/1780] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:18.923724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.933593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4840ea-6e51-4336-a217-e56f438f1a2d service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.935068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e1281-7923-4b29-a432-eb2ba0acb6e7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.940130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.940321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.941164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.941470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.941729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.941840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.942176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.942505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.942699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.944125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.956542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 885/1781] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:18.957455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:18.965692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:18.967662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:18.967884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398c22b-0aef-46d1-8663-b0753aed9c7e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:18.972392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:18.973749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:18.973749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:18.973913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:18.976039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:18.992985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 897/1782] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:10:18.993858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:19.024585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cf35e-e972-4ef8-85ef-f1677000a90c service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:19.036473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:19.037441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:19.037731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:19.038109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] PATH_INFO: `/v3/projects/410b720b5d114842b5c5b751b35ce012/users/8abf00de915544fb9ca0c14b6d9998cf/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:19.078673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410b720b5d114842b5c5b751b35ce012, user_id=8abf00de915544fb9ca0c14b6d9998cf, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:19.085551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:19.126438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 898/1783] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:18 2022] PUT /identity/v3/projects/410b720b5d114842b5c5b751b35ce012/users/8abf00de915544fb9ca0c14b6d9998cf/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:19.126438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:19.131174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:19.133547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:19.151730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 886/1784] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:19.165201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:19.171134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:19.203339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08909-a124-4f94-bead-ff70056ea5f6 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:19.310011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f31af-57f9-4c04-958b-72e660683b10 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:19.339876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116ed7-2b43-4a69-a954-77354da5b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:19.339876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116ed7-2b43-4a69-a954-77354da5b8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:19.339876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116ed7-2b43-4a69-a954-77354da5b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:19.339876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116ed7-2b43-4a69-a954-77354da5b8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:19.340156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116ed7-2b43-4a69-a954-77354da5b8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:19.342953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116ed7-2b43-4a69-a954-77354da5b8eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:19.388088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 899/1785] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:19.388088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5421-fa04-4b57-8162-264a2c447c28 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:19.389780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5421-fa04-4b57-8162-264a2c447c28 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:19.389780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5421-fa04-4b57-8162-264a2c447c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:19.403072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:19.404048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:19.404351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:19.407447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] PATH_INFO: `/v3/users/c7ad1357e4fd4004af115616f8e087a7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:19.410045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ad1357e4fd4004af115616f8e087a7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:19.417904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:19.481484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-671a5421-fa04-4b57-8162-264a2c447c28 None None] MFA Rules not processed for user `8abf00de915544fb9ca0c14b6d9998cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:19.484059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-671a5421-fa04-4b57-8162-264a2c447c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:19.494065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:19.499150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:19.573073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ad1357e4fd4004af115616f8e087a7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:19.616333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ad1357e4fd4004af115616f8e087a7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:19.617428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ad1357e4fd4004af115616f8e087a7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:19.618265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ad1357e4fd4004af115616f8e087a7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:19.647157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ad1357e4fd4004af115616f8e087a7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:19.691203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 887/1786] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:19 2022] DELETE /identity/v3/users/c7ad1357e4fd4004af115616f8e087a7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:19.694084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:19.699509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:19.745714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 900/1787] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:19.752710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:19.756345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:19.756881 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:19.837976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:19.843463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.031850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695aab6-21ce-4c52-a425-3d0f0a29c5f0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.055930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 901/1788] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:20.056397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc7e8-ca0b-4cbd-816a-4f6d796af798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.056979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.058761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.062450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc7e8-ca0b-4cbd-816a-4f6d796af798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.069742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc7e8-ca0b-4cbd-816a-4f6d796af798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.070085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc7e8-ca0b-4cbd-816a-4f6d796af798 admin admin] PATH_INFO: `/v3/projects/127f7ef71c774da4a825dff6e323d48a/users/9912257748854db6be0c75decdf2306b/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.090369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cc1ec-2365-44dd-907b-77e8f382c7e1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.105021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.105851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.106166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.106447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.107156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.112252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.146881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc7e8-ca0b-4cbd-816a-4f6d796af798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127f7ef71c774da4a825dff6e323d48a, user_id=9912257748854db6be0c75decdf2306b, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.156704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc7e8-ca0b-4cbd-816a-4f6d796af798 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.199022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 902/1789] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:20 2022] POST /identity/v3/projects => generated 357 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:20.202893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.218045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 888/1790] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:19 2022] PUT /identity/v3/projects/127f7ef71c774da4a825dff6e323d48a/users/9912257748854db6be0c75decdf2306b/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:20.220420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.220718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.221084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.292814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] MFA Rules not processed for user `9912257748854db6be0c75decdf2306b`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:20.297398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.352549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3b0c0-a78f-4354-9cab-9dea75881fec admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.361102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.361921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.362391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.364019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.364956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.371514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.420138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 903/1791] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:20 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:20.421133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.425921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.449547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c604d-b276-46d8-8350-4334d71c8c2b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.462707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.465543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.465949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.469130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] PATH_INFO: `/v3/users/28cf7ff250534e42a6a79a96fa8fd16e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.471188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cf7ff250534e42a6a79a96fa8fd16e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.477968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.493272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:20.535001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 889/1792] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:20.536444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.546773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.599542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:20.631032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cf7ff250534e42a6a79a96fa8fd16e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:20.642775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cf7ff250534e42a6a79a96fa8fd16e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:20.644465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cf7ff250534e42a6a79a96fa8fd16e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:20.663168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cf7ff250534e42a6a79a96fa8fd16e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:20.664467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cf7ff250534e42a6a79a96fa8fd16e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:20.684235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3b55c-183e-4101-b178-c86ed62a243d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.688348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.689006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.689294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.689576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.694962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 904/1793] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:20 2022] DELETE /identity/v3/users/28cf7ff250534e42a6a79a96fa8fd16e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:20.697593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.698906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.699925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.731762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.733851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.758307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 890/1794] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:20.759245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.771842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.795867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321b4e-9772-4f7c-8a03-4626c13c62d3 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.817015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7446-2f6a-4ac8-a89b-aee09267b841 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.825404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.826393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.827083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.827634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.828903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.830950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.851075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 905/1795] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:20.852980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:20.856725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:20.880540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547de03b-6b92-40db-be57-7c1eb644241f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:20.891485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.893200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.894426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.894669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] PATH_INFO: `/v3/users/217a7875fa7d4735a14312bf308fb10d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.899028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217a7875fa7d4735a14312bf308fb10d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.900957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:20.926504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddbd47-e4c0-40b3-a988-5d6af9afb765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:20.928578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddbd47-e4c0-40b3-a988-5d6af9afb765 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:20.930108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddbd47-e4c0-40b3-a988-5d6af9afb765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:20.931914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddbd47-e4c0-40b3-a988-5d6af9afb765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:20.934374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddbd47-e4c0-40b3-a988-5d6af9afb765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:20.939231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddbd47-e4c0-40b3-a988-5d6af9afb765 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:21.052060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217a7875fa7d4735a14312bf308fb10d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:21.052798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 891/1796] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:20 2022] POST /identity/v3/projects => generated 405 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:21.055931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:21.056248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:21.056779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:21.081624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217a7875fa7d4735a14312bf308fb10d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:21.083093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217a7875fa7d4735a14312bf308fb10d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:21.116122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:21.116435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217a7875fa7d4735a14312bf308fb10d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:21.117137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217a7875fa7d4735a14312bf308fb10d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:21.117382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:21.162334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:21.215155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 906/1797] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:20 2022] DELETE /identity/v3/users/217a7875fa7d4735a14312bf308fb10d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:21.217022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:21.222604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:21.333255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 892/1798] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:21.333255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:21.343148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:21.380694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5ed5b-b1d4-4fa6-83fd-0a90570647f8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:21.478962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de1d05-96c0-4f55-b14f-3b96424069b1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:21.491780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc5a63-67f6-4765-b59a-dcfaf5c0430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:21.492703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5a63-67f6-4765-b59a-dcfaf5c0430c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:21.492987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5a63-67f6-4765-b59a-dcfaf5c0430c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:21.493269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc5a63-67f6-4765-b59a-dcfaf5c0430c admin admin] PATH_INFO: `/v3/projects/ba598feb13d44b50a6ceb17d9577faea/users/d295a6a15f11434aa069a93f464c9775/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:21.512999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:21.544559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc5a63-67f6-4765-b59a-dcfaf5c0430c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba598feb13d44b50a6ceb17d9577faea, user_id=d295a6a15f11434aa069a93f464c9775, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:21.547572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc5a63-67f6-4765-b59a-dcfaf5c0430c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:21.571100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 907/1799] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:21 2022] PUT /identity/v3/projects/ba598feb13d44b50a6ceb17d9577faea/users/d295a6a15f11434aa069a93f464c9775/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:21.572686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:21.572984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:21.573296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:21.595409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:21.597375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:21.597851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:21.599749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:21.606881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:21.614573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:21.651722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:21.661765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:21.699562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 893/1800] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:21 2022] POST /identity/v3/users => generated 309 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:21.700459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:21.712893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:21.889364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 908/1801] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Jun 24 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:21.891691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:21.928512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630ff683-a866-47dd-b3b9-787c289ad520 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:21.950360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:21.951115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:21.951426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:21.951711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.131080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383214-4fe6-4436-a573-3999a434f042 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.143127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.144393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.144677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.144951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.150579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.153188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.153668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.157214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.190042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 909/1802] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:22.192629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.195841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:22.204497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 894/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:22.207836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.247658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d42ed-d37f-401a-bd61-b48257ad9d2b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.254080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69ec06-3bc1-4178-ab1e-97bc127ede3e service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.269214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.270689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.271151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.271576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] PATH_INFO: `/v3/projects/cf8369aaec054cfe95b7cb9d0b5b4c13` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.273342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8369aaec054cfe95b7cb9d0b5b4c13)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.274807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.275505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.275798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.276186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.276335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.276983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.290093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.343114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 895/1804] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:22.343114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.345802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:22.372213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446d149-2ece-4e1e-b3fe-405e941f8f13 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.393236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.393236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.393236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.393236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.406977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.415815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.424247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8369aaec054cfe95b7cb9d0b5b4c13', 'request_id': 'req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:22.432195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8369aaec054cfe95b7cb9d0b5b4c13', 'request_id': 'req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:22.440269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 896/1805] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:22.441814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8369aaec054cfe95b7cb9d0b5b4c13', 'request_id': 'req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:22.442475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.462454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea9a0-5102-4244-99b1-649f3a70dfdc service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.470629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] The token cache is being invalidate because project cf8369aaec054cfe95b7cb9d0b5b4c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:22.470927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:22.471684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:22.480079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 910/1806] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:22 2022] DELETE /identity/v3/projects/cf8369aaec054cfe95b7cb9d0b5b4c13 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:22.480079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.484716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:22.614505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.616835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.616835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.616835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.625892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:22.663621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.667426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.668219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9d09-d434-4e2c-a0b2-23e71b08fec0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.676616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:22.688359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 897/1807] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:22.691837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.693210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.694104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.694860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:22.700539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.701024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] PATH_INFO: `/v3/projects/ba598feb13d44b50a6ceb17d9577faea/users/d295a6a15f11434aa069a93f464c9775/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.708624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba598feb13d44b50a6ceb17d9577faea, user_id=d295a6a15f11434aa069a93f464c9775, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.714875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80ec3-b4ed-4f62-aea9-9cff55da87e0 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.718539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.725186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.727063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.727902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.728724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.746755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.749105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.752993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 911/1808] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:22 2022] PUT /identity/v3/projects/ba598feb13d44b50a6ceb17d9577faea/users/d295a6a15f11434aa069a93f464c9775/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:22.757152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.759449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:22.773215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 898/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:22.786016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:22.792926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:22.839073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae14b6-2cc1-4a51-891a-23acf672e61f service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.932210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063b7dd-17cc-47f8-b5dc-48e40bc4a493 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:22.948484 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562de1-3983-4041-8e10-8b378a58f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:22.949371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562de1-3983-4041-8e10-8b378a58f88c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:22.949720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562de1-3983-4041-8e10-8b378a58f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:22.949946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562de1-3983-4041-8e10-8b378a58f88c admin admin] PATH_INFO: `/v3/projects/dfec2c01d6544b57a04152dc20ba6456/users/3762f38fbbdf4fe3b155049201df21c1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:22.987298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562de1-3983-4041-8e10-8b378a58f88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfec2c01d6544b57a04152dc20ba6456, user_id=3762f38fbbdf4fe3b155049201df21c1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:22.991244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562de1-3983-4041-8e10-8b378a58f88c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:22.999919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:23.000818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.002014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.002014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] PATH_INFO: `/v3/projects/a960067fefd8452fbd0b3f1244f375d7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.005030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a960067fefd8452fbd0b3f1244f375d7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:23.011138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:23.026213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 912/1810] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:22 2022] PUT /identity/v3/projects/dfec2c01d6544b57a04152dc20ba6456/users/3762f38fbbdf4fe3b155049201df21c1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:23.027642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ac05-eca6-4b12-9761-ee2a2496efd9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.027943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ac05-eca6-4b12-9761-ee2a2496efd9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.028228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ac05-eca6-4b12-9761-ee2a2496efd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.071729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3374ac05-eca6-4b12-9761-ee2a2496efd9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:23.073308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3374ac05-eca6-4b12-9761-ee2a2496efd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:23.115604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:23.167993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a960067fefd8452fbd0b3f1244f375d7', 'request_id': 'req-aca210e7-378e-4489-a159-2fb8cedaecec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.180965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a960067fefd8452fbd0b3f1244f375d7', 'request_id': 'req-aca210e7-378e-4489-a159-2fb8cedaecec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.195379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a960067fefd8452fbd0b3f1244f375d7', 'request_id': 'req-aca210e7-378e-4489-a159-2fb8cedaecec'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.230304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 913/1811] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:23.232991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] The token cache is being invalidate because project a960067fefd8452fbd0b3f1244f375d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:23.233204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.233309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.233895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.233895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.234030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.238548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 899/1812] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:22 2022] DELETE /identity/v3/projects/a960067fefd8452fbd0b3f1244f375d7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:23.239588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:23.247608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:23.356844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] MFA Rules not processed for user `d295a6a15f11434aa069a93f464c9775`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:23.360290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:23.527747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca210e7-378e-4489-a159-2fb8cedaecec admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:23.559725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33550761-8da6-4ac2-977c-bf1682b54442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:23.560992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33550761-8da6-4ac2-977c-bf1682b54442 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.563518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33550761-8da6-4ac2-977c-bf1682b54442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.564169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33550761-8da6-4ac2-977c-bf1682b54442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.565981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33550761-8da6-4ac2-977c-bf1682b54442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:23.579469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33550761-8da6-4ac2-977c-bf1682b54442 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:23.610567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 900/1813] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:23.614184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.615443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.615443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.659450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:23.659547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 914/1814] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:23.659547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:23.659688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:23.664417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:23.676613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 901/1815] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:23.678178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:23.694633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bb502-d72c-4cd9-a6a3-1182dee83689 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:23.701811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:23.703104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.703578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.704071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] PATH_INFO: `/v3/projects/dfec2c01d6544b57a04152dc20ba6456/users/3762f38fbbdf4fe3b155049201df21c1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.708006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfec2c01d6544b57a04152dc20ba6456, user_id=3762f38fbbdf4fe3b155049201df21c1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:23.708534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a603e-3bd2-4b63-a99f-58984334193a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:23.712194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:23.715239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:23.721248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:23.722430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.722760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.723315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] PATH_INFO: `/v3/users/aa80e2d386e347c593bff7e3bf053f31` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.730098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa80e2d386e347c593bff7e3bf053f31)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:23.733406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:23.745694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 902/1816] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:23 2022] PUT /identity/v3/projects/dfec2c01d6544b57a04152dc20ba6456/users/3762f38fbbdf4fe3b155049201df21c1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:23.747112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:23.750155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:23.861383 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0e14-5b93-40aa-a4cc-1cfd50315233 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:23.875105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cf5ce-21ec-4a37-9b77-8f144c0e022d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:23.876261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf5ce-21ec-4a37-9b77-8f144c0e022d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:23.877002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf5ce-21ec-4a37-9b77-8f144c0e022d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:23.877002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cf5ce-21ec-4a37-9b77-8f144c0e022d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:23.894081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa80e2d386e347c593bff7e3bf053f31'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.908332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa80e2d386e347c593bff7e3bf053f31'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.909900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa80e2d386e347c593bff7e3bf053f31'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.939474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa80e2d386e347c593bff7e3bf053f31'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.942808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa80e2d386e347c593bff7e3bf053f31'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:23.992651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cf5ce-21ec-4a37-9b77-8f144c0e022d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:23.996098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cf5ce-21ec-4a37-9b77-8f144c0e022d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:23.997393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 915/1817] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:23 2022] DELETE /identity/v3/users/aa80e2d386e347c593bff7e3bf053f31 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:23.998274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:24.003824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:24.023197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 903/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:23 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:24.034128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:24.034530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:24.034902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:24.054274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:24.115115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] MFA Rules not processed for user `3762f38fbbdf4fe3b155049201df21c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:24.137883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:24.149107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e779dd-022d-4746-9ffa-ff2bb9bd0cc5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:24.164637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:24.165684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:24.166837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:24.166837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:24.167237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:24.167615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:24.169327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:24.199834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 916/1819] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:24.201042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:24.203531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:24.323938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56796a4c-1807-4cf2-861f-5fd8e3612ccf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:24.328518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:24.329316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:24.329716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:24.330105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:24.342079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:24.412651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 904/1820] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:24.412651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:24.435744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cb855-ee72-4b9d-aabf-4d212c926b69 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:24.449185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:24.449875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:24.450200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:24.451286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:24.452065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:24.454395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:24.509119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:24.510856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:24.519356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 905/1821] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:24 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:24.519356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:24.522925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:24.535690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 917/1822] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:24 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:24.537027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:24.543572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:24.562613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:24.567230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020c6b-6936-4e9e-9c4f-303f74dcde2f service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:24.693453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:24.694243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:24.695964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:24.696272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:24.764866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:24.780089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1053164-da68-404f-b9e1-ee4e1baccb94 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:24.791738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:24.792887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:24.793182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:24.794008 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] PATH_INFO: `/v3/projects/9e240bdde7a34af58a0f1531b2884a88` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:24.795342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e240bdde7a34af58a0f1531b2884a88)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:24.798044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:24.944782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:24.951602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:24.967664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e240bdde7a34af58a0f1531b2884a88', 'request_id': 'req-20920141-4a8b-4dbe-966e-a08713551d86'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:24.983199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e240bdde7a34af58a0f1531b2884a88', 'request_id': 'req-20920141-4a8b-4dbe-966e-a08713551d86'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:24.990646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 918/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:24.991640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:25.009266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e240bdde7a34af58a0f1531b2884a88', 'request_id': 'req-20920141-4a8b-4dbe-966e-a08713551d86'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.026635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57378116-634f-4abd-83ce-3b8d73e529fd service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:25.136085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] The token cache is being invalidate because project 9e240bdde7a34af58a0f1531b2884a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:25.136547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.137967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.146445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 906/1824] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:24 2022] DELETE /identity/v3/projects/9e240bdde7a34af58a0f1531b2884a88 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:25.151237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:25.154174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:25.198524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:25.201740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.202984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.203402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.206936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:25.217770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:25.226398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920141-4a8b-4dbe-966e-a08713551d86 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:25.242257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:25.243296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.243630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.244058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] PATH_INFO: `/v3/users/a905310ade014f15a802e2ca459572fc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.246372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a905310ade014f15a802e2ca459572fc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:25.268160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:25.279004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 919/1825] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:24 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:25.282778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:25.305670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:25.333391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5db46-0fb1-491b-ad4b-ad28ad894a1c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:25.355116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:25.356266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.356655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.357072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] PATH_INFO: `/v3/users/96741a4f7328493aa12c5755394f100f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.358984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96741a4f7328493aa12c5755394f100f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:25.361205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:25.448766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a905310ade014f15a802e2ca459572fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.466047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a905310ade014f15a802e2ca459572fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.467214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a905310ade014f15a802e2ca459572fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.468498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a905310ade014f15a802e2ca459572fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.488546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a905310ade014f15a802e2ca459572fc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.496199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96741a4f7328493aa12c5755394f100f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.518167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 907/1826] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:25 2022] DELETE /identity/v3/users/a905310ade014f15a802e2ca459572fc => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:25.522035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:25.523353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96741a4f7328493aa12c5755394f100f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.525007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96741a4f7328493aa12c5755394f100f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.526041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:25.546474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96741a4f7328493aa12c5755394f100f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.547589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96741a4f7328493aa12c5755394f100f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.573507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:25.604197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 920/1827] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:25 2022] DELETE /identity/v3/users/96741a4f7328493aa12c5755394f100f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:25.605149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:25.608671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:25.648654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:25.722288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc78618-f414-4b2e-b58c-f202b6364689 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:25.736504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737d221-48d2-4f6f-8508-892e6d4ea247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:25.738404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737d221-48d2-4f6f-8508-892e6d4ea247 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.740280 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737d221-48d2-4f6f-8508-892e6d4ea247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.740673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737d221-48d2-4f6f-8508-892e6d4ea247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.741608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737d221-48d2-4f6f-8508-892e6d4ea247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:25.744987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737d221-48d2-4f6f-8508-892e6d4ea247 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:25.753040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abae3c-aa65-4f8e-922c-3b3441b9199c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:25.763904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:25.764864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.765203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.766253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] PATH_INFO: `/v3/users/9912257748854db6be0c75decdf2306b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.769096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9912257748854db6be0c75decdf2306b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:25.778944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 908/1828] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:25.784854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:25.788688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.789110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.789498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.825168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:25.826834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:25.860181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 909/1829] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:25.864134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:25.866214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:25.911480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b56e7-ce2e-476c-b9ed-d15955904426 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:25.923659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9912257748854db6be0c75decdf2306b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.942352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9912257748854db6be0c75decdf2306b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.943424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9912257748854db6be0c75decdf2306b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.954927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccf1c4-52da-4c10-95f1-85e479777542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:25.955540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf1c4-52da-4c10-95f1-85e479777542 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.955830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf1c4-52da-4c10-95f1-85e479777542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.956730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccf1c4-52da-4c10-95f1-85e479777542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.957408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf1c4-52da-4c10-95f1-85e479777542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:25.959087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccf1c4-52da-4c10-95f1-85e479777542 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:25.965120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9912257748854db6be0c75decdf2306b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.966072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9912257748854db6be0c75decdf2306b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:25.989954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 910/1830] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:25.991580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e141d0-1bca-473e-b655-adab584bbca7 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:25.992124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e141d0-1bca-473e-b655-adab584bbca7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:25.992124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e141d0-1bca-473e-b655-adab584bbca7 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:25.997881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 911/1831] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:10:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:25.999260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e141d0-1bca-473e-b655-adab584bbca7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:26.007649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d8e141d0-1bca-473e-b655-adab584bbca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.010288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 921/1832] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:25 2022] DELETE /identity/v3/users/9912257748854db6be0c75decdf2306b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:26.010288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:26.012809 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.207382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0cdd-27d4-40d7-aa9e-a168267ba522 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:26.212140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e141d0-1bca-473e-b655-adab584bbca7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:26.214949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596d5e-8ce8-4bbb-add2-dc6ccad499e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:26.216074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596d5e-8ce8-4bbb-add2-dc6ccad499e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.216750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596d5e-8ce8-4bbb-add2-dc6ccad499e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.218184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596d5e-8ce8-4bbb-add2-dc6ccad499e8 admin admin] PATH_INFO: `/v3/projects/fc50b737243549c085a630da96da8a47/users/eb9ab49f6f27456ba9fa60842abaa78d/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.225136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:26.225821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.226104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.226413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.228398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.258395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:26.259846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42340794-a82a-49bc-aeca-7a63e4d7cedd service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:26.267778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596d5e-8ce8-4bbb-add2-dc6ccad499e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc50b737243549c085a630da96da8a47, user_id=eb9ab49f6f27456ba9fa60842abaa78d, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:26.279004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596d5e-8ce8-4bbb-add2-dc6ccad499e8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:26.281762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 912/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:26.283194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.283395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.283678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.319314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:26.320550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.324372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 922/1834] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:26 2022] PUT /identity/v3/projects/fc50b737243549c085a630da96da8a47/users/eb9ab49f6f27456ba9fa60842abaa78d/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:26.334192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3065ea-7670-4678-9312-35cbd23ffc9d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.334759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3065ea-7670-4678-9312-35cbd23ffc9d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.336687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3065ea-7670-4678-9312-35cbd23ffc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.401033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9b3065ea-7670-4678-9312-35cbd23ffc9d None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:26.408300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b3065ea-7670-4678-9312-35cbd23ffc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.473983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:26.505225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 913/1835] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:26.506950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:26.511042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.551241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d977f6e-e2b4-41a1-b95d-eee76922ecec None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:26.580205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:26.583922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.589400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.591062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] PATH_INFO: `/v3/projects/a9b81972648d443ba3c50c721525a12f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.596022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b81972648d443ba3c50c721525a12f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:26.598692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:26.661625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:26.688003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 923/1836] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:10:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:26.689393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.689836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.690129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.753292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] MFA Rules not processed for user `eb9ab49f6f27456ba9fa60842abaa78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:26.755024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.757174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b81972648d443ba3c50c721525a12f', 'request_id': 'req-01900db1-c46b-4416-8759-8258c489904f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:26.783925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b81972648d443ba3c50c721525a12f', 'request_id': 'req-01900db1-c46b-4416-8759-8258c489904f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:26.800971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b81972648d443ba3c50c721525a12f', 'request_id': 'req-01900db1-c46b-4416-8759-8258c489904f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:26.841801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] The token cache is being invalidate because project a9b81972648d443ba3c50c721525a12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:26.843234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:26.844113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-01900db1-c46b-4416-8759-8258c489904f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:26.845782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 914/1837] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:26 2022] DELETE /identity/v3/projects/a9b81972648d443ba3c50c721525a12f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:26.847330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775ad9-df38-4c5d-9b5e-11e374246d9b None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:26.848333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775ad9-df38-4c5d-9b5e-11e374246d9b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:26.848634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07775ad9-df38-4c5d-9b5e-11e374246d9b None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:26.852250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 915/1838] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:26.856705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775ad9-df38-4c5d-9b5e-11e374246d9b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:26.860898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-07775ad9-df38-4c5d-9b5e-11e374246d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:26.923765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 924/1839] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:26.925254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:26.927915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.011857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07775ad9-df38-4c5d-9b5e-11e374246d9b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.023929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.024676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.025034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.025320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.028119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.101135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7262-111d-447e-8180-d2ff7b1112b1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.117987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.119839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.120142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.120465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.127373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.221230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.226725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.228027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.229592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8ae24-7f95-4105-886b-fcdbe46128de service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.254359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 916/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:27.255925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2b6a-b58a-4211-bb33-03959c0450d6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.256212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2b6a-b58a-4211-bb33-03959c0450d6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.257254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 925/1841] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:27.257905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc2b6a-b58a-4211-bb33-03959c0450d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.272423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.281605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.312113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9ffc2b6a-b58a-4211-bb33-03959c0450d6 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:27.313981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ffc2b6a-b58a-4211-bb33-03959c0450d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.346191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 917/1842] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:27.348472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff291f-8353-4b86-b13c-805c048f2ff6 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.349045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff291f-8353-4b86-b13c-805c048f2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.349532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff291f-8353-4b86-b13c-805c048f2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.372895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324abd-3ccf-4a77-a3d4-d7fd36f00846 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.380070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.381014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.381439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.381859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.382780 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.384846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.421255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-caff291f-8353-4b86-b13c-805c048f2ff6 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:27.423792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-caff291f-8353-4b86-b13c-805c048f2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.453737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 918/1843] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:27.455351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.455647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.455967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.461524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 926/1844] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:27 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:27.462595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.482534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:27.509727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:27.511063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:27.566476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888279-a970-4c47-b71f-07db4b9719f3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.571602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.572452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.572976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.573380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.574398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.576445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.645312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 927/1845] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:27 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:27.646488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.659960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ecdc2-37fd-49f8-bcbf-e95d2594957d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.666654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.667422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.667784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.668133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.668992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.670818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.677946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:27.695093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 928/1846] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:27.696121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.709823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81c086-c639-462f-bcbf-3afee3a51cd3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.717135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.718706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.719098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.719493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] PATH_INFO: `/v3/projects/e2a47b4fee094ca7ae00b90c19583a2f/users/69c7036121bd4c0faf1762f72a56a742/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.730753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 919/1847] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:27.735402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.750060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a47b4fee094ca7ae00b90c19583a2f, user_id=69c7036121bd4c0faf1762f72a56a742, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.756558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.765675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4223d4e-e705-437b-926a-7e756cbbde33 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:27.780589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:27.781288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:27.781642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:27.781911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:27.782686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:27.785552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 929/1848] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:27 2022] PUT /identity/v3/projects/e2a47b4fee094ca7ae00b90c19583a2f/users/69c7036121bd4c0faf1762f72a56a742/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:27.786281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:27.788203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:27.793026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.822637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 920/1849] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:27.826300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:27.855316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32375b1-4f18-41c0-b7ac-88faeef0f20b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:28.119760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe383-8930-4a29-8574-82ff7832613f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:28.126133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:28.127223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:28.127673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:28.128771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:28.129744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:28.131895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:28.133295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:28.134954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:28.135339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:28.135629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:28.136342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:28.138278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:28.159416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 930/1850] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:28.161343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:28.163734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:28.211772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 921/1851] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:27 2022] POST /identity/v3/projects => generated 373 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:28.211772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:28.406585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:28.558352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaaab5-5d02-4493-8d76-2b6a19c2ccb7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:28.613222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d344467-f201-4716-b7c6-fcd3a78f777a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:28.632372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:28.635323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:28.635612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:28.635893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] PATH_INFO: `/v3/projects/e2a47b4fee094ca7ae00b90c19583a2f/users/69c7036121bd4c0faf1762f72a56a742/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:28.646305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a47b4fee094ca7ae00b90c19583a2f, user_id=69c7036121bd4c0faf1762f72a56a742, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:28.656675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:28.695654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 922/1852] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:28 2022] PUT /identity/v3/projects/e2a47b4fee094ca7ae00b90c19583a2f/users/69c7036121bd4c0faf1762f72a56a742/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:28.698550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:28.821752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:28.822584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:28.823319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:28.823439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:28.836085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:28.838577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:28.855478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 931/1853] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:28.856270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:28.857671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:28.872860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02100b5-6af3-4500-8e1e-a3b3e79febd8 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:28.913058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:28.922976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14586493-34a2-43f3-8553-02ffad47745d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:28.930912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e0b4f-1f5c-4cda-8ae8-965d7a81fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:28.931765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0b4f-1f5c-4cda-8ae8-965d7a81fb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:28.932882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0b4f-1f5c-4cda-8ae8-965d7a81fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:28.932882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e0b4f-1f5c-4cda-8ae8-965d7a81fb6b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:28.933887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0b4f-1f5c-4cda-8ae8-965d7a81fb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:28.937243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e0b4f-1f5c-4cda-8ae8-965d7a81fb6b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:28.975845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 923/1854] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:28 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:28.977704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:28.978159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:28.978632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:29.017494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:29.018469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:29.019125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:29.019451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] PATH_INFO: `/v3/projects/34de8f9ff85e4056b08a8699fed34947` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:29.023521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34de8f9ff85e4056b08a8699fed34947)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:29.026513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:29.046001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] MFA Rules not processed for user `69c7036121bd4c0faf1762f72a56a742`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:29.047570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:29.189516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34de8f9ff85e4056b08a8699fed34947', 'request_id': 'req-32cec616-13f5-43f7-b9ce-3dea48c99a0f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.202551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 924/1855] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:29.207009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:29.207509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34de8f9ff85e4056b08a8699fed34947', 'request_id': 'req-32cec616-13f5-43f7-b9ce-3dea48c99a0f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.211588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:29.223787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34de8f9ff85e4056b08a8699fed34947', 'request_id': 'req-32cec616-13f5-43f7-b9ce-3dea48c99a0f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.255054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c41e17-92e9-4f44-b5b9-3e34b724c955 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:29.273302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] The token cache is being invalidate because project 34de8f9ff85e4056b08a8699fed34947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:29.273658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.275194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.280762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 932/1856] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:28 2022] DELETE /identity/v3/projects/34de8f9ff85e4056b08a8699fed34947 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:29.281597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:29.286884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:29.339039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:29.419647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:29.421503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:29.423279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:29.425005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] PATH_INFO: `/v3/projects/6f6513ea887c42f8824702e9255e96fc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:29.428892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6513ea887c42f8824702e9255e96fc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:29.436395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:29.543263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cec616-13f5-43f7-b9ce-3dea48c99a0f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:29.584374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6513ea887c42f8824702e9255e96fc', 'request_id': 'req-613c0ac8-7a0a-470d-b953-ba8aea424410'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.596813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6513ea887c42f8824702e9255e96fc', 'request_id': 'req-613c0ac8-7a0a-470d-b953-ba8aea424410'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.609733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6513ea887c42f8824702e9255e96fc', 'request_id': 'req-613c0ac8-7a0a-470d-b953-ba8aea424410'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.643118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] The token cache is being invalidate because project 6f6513ea887c42f8824702e9255e96fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:29.644884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.647753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.658061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 925/1857] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:29 2022] DELETE /identity/v3/projects/6f6513ea887c42f8824702e9255e96fc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:29.659623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:29.661772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:29.672099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:29.731965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:29.733798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:29.734107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:29.734451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:29.735291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:29.737860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:29.778044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 933/1858] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:29.781947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:29.789885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:29.813157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded133c8-f1ce-4dfb-9c42-943335f810ee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:29.817383 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c0ac8-7a0a-470d-b953-ba8aea424410 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:29.822385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:29.823742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:29.824142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:29.824503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] PATH_INFO: `/v3/users/dd2917561e314c8aabe7e0564a02614e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:29.826157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2917561e314c8aabe7e0564a02614e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:29.827458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:29.828500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:29.829231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:29.829730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:29.830415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:29.833310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:29.909845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2917561e314c8aabe7e0564a02614e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.923979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2917561e314c8aabe7e0564a02614e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.925707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2917561e314c8aabe7e0564a02614e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.946403 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2917561e314c8aabe7e0564a02614e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.947155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2917561e314c8aabe7e0564a02614e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:29.969035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:29.978261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd394e-5afb-44f4-a963-229da4afef6d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:29.999963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 934/1859] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:29 2022] DELETE /identity/v3/users/dd2917561e314c8aabe7e0564a02614e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:30.000931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:30.012834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 926/1860] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:30.016356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.025565 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.036400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.036400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.068288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:30.069896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.089849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:30.169679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19883be8-b22e-41e6-97a6-b76c8403b127 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:30.183003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:30.184051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.184334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.186053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] PATH_INFO: `/v3/projects/127f7ef71c774da4a825dff6e323d48a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.187875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127f7ef71c774da4a825dff6e323d48a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:30.194671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:30.196581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 927/1861] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:30.198376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:30.200244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.233688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea4f90-6593-455f-94e4-69ae31173cc9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:30.253308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef569a-d1bd-4770-b1cf-53bcb95a50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:30.255334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef569a-d1bd-4770-b1cf-53bcb95a50c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.255628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef569a-d1bd-4770-b1cf-53bcb95a50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.256550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef569a-d1bd-4770-b1cf-53bcb95a50c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.259227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef569a-d1bd-4770-b1cf-53bcb95a50c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:30.264014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef569a-d1bd-4770-b1cf-53bcb95a50c2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:30.293713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 928/1862] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:30.293713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.293713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.293713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.321234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127f7ef71c774da4a825dff6e323d48a', 'request_id': 'req-3ccc69b0-d212-4215-8b6e-2103c1ada788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.331116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127f7ef71c774da4a825dff6e323d48a', 'request_id': 'req-3ccc69b0-d212-4215-8b6e-2103c1ada788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.339685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127f7ef71c774da4a825dff6e323d48a', 'request_id': 'req-3ccc69b0-d212-4215-8b6e-2103c1ada788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.350174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:30.351554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.361922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] The token cache is being invalidate because project 127f7ef71c774da4a825dff6e323d48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:30.363045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.364521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.371208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 935/1863] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:29 2022] DELETE /identity/v3/projects/127f7ef71c774da4a825dff6e323d48a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:30.372998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:30.388503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.493610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:30.555973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 929/1864] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:30.557051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:30.558525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.592386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d308b-a87c-4e09-bc75-85686035416b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:30.608509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:30.609532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.609893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.611338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] PATH_INFO: `/v3/users/3762f38fbbdf4fe3b155049201df21c1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.612856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3762f38fbbdf4fe3b155049201df21c1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:30.618846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:30.632333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc69b0-d212-4215-8b6e-2103c1ada788 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:30.665434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c92ef-fb5c-4a61-ac07-aa9199f2253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:30.675268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c92ef-fb5c-4a61-ac07-aa9199f2253f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.675268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c92ef-fb5c-4a61-ac07-aa9199f2253f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.678623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c92ef-fb5c-4a61-ac07-aa9199f2253f admin admin] PATH_INFO: `/v3/projects/8f75996f180348119570c8f441ad7b74/users/f044e708e0804aefb3a6e4c824a729d5/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.724843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3762f38fbbdf4fe3b155049201df21c1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.742549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3762f38fbbdf4fe3b155049201df21c1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.743618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3762f38fbbdf4fe3b155049201df21c1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.746292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3762f38fbbdf4fe3b155049201df21c1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.766686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c92ef-fb5c-4a61-ac07-aa9199f2253f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f75996f180348119570c8f441ad7b74, user_id=f044e708e0804aefb3a6e4c824a729d5, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:30.772956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3762f38fbbdf4fe3b155049201df21c1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:30.773982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c92ef-fb5c-4a61-ac07-aa9199f2253f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:30.799834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 930/1865] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:30 2022] DELETE /identity/v3/users/3762f38fbbdf4fe3b155049201df21c1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:30.799834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:30.802293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.813543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 936/1866] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:30 2022] PUT /identity/v3/projects/8f75996f180348119570c8f441ad7b74/users/f044e708e0804aefb3a6e4c824a729d5/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:30.828782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:30.829153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:30.829485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:30.885222 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] MFA Rules not processed for user `f044e708e0804aefb3a6e4c824a729d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:30.886619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:30.932254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbdd4-6371-4e69-81c3-47d50d2aad2d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:30.985638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:31.089218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 937/1867] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:31.094015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.095729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.097842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.100638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.101986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.102310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.103089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:31.103408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.105063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.115807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:31.127035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d53eb-33f9-4561-ae41-fcdcaf00b9de None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.137320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.139519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.139824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.140146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.147407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 931/1868] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:31.147820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.148836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.151176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.164050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ad9ed-d5cd-49ae-8656-6accafe7dc4d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.172266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.173289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.173974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.174599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.176331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.179054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.214785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 938/1869] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:31 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:31.216051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.218502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.228401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 932/1870] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:31 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:31.228401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.355139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc24687-929a-43b6-b9ff-bebef48ae5a3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.376439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.381179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.381672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.382147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.383120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.385245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.395993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b8ab-b1e5-448d-999b-7d95e8c8fd0a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.402153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.403387 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.403702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.404010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] PATH_INFO: `/v3/projects/780f10a21bd64040bba6782ac3c4b490` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.407184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780f10a21bd64040bba6782ac3c4b490)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.409467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.418134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 933/1871] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:31 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:31.420545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.440118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b3d9-1613-46b0-8caf-67d18ee9edbc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.453861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.453861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.453861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.453861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.454304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.455560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.483395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 934/1872] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:31 2022] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:31.484989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.489036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780f10a21bd64040bba6782ac3c4b490', 'request_id': 'req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.495884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780f10a21bd64040bba6782ac3c4b490', 'request_id': 'req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.501272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455dd3-9593-4aa3-b43f-5952e65507e2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.504296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780f10a21bd64040bba6782ac3c4b490', 'request_id': 'req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.525099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] The token cache is being invalidate because project 780f10a21bd64040bba6782ac3c4b490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:31.525363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.527217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.530107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 939/1873] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:31 2022] DELETE /identity/v3/projects/780f10a21bd64040bba6782ac3c4b490 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:31.531544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.535359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.577015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484fa0a-67f5-4699-accc-80c015be3284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.577691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484fa0a-67f5-4699-accc-80c015be3284 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.577975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484fa0a-67f5-4699-accc-80c015be3284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.578278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484fa0a-67f5-4699-accc-80c015be3284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.579017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484fa0a-67f5-4699-accc-80c015be3284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.580628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484fa0a-67f5-4699-accc-80c015be3284 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.592021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 935/1874] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:31.593548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.593913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.594136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.614659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:31.622253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:31.623596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.642484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 936/1875] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:31.643720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.645619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.663802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860d4ea-967e-46f1-a4cf-b417e3cf6fea None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.675309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.676863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.677711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3db01-ec89-4e5c-a0fb-8a82f59afaa6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.678883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.679450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] PATH_INFO: `/v3/projects/240ac545cce3449ebac5a79528297842/users/f202e4fff4be498bba5c022732bf3531/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.683371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edccff-0646-4588-8cbe-9e61efa68e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.684248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edccff-0646-4588-8cbe-9e61efa68e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.684533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edccff-0646-4588-8cbe-9e61efa68e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.684812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edccff-0646-4588-8cbe-9e61efa68e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.685668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edccff-0646-4588-8cbe-9e61efa68e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.687361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edccff-0646-4588-8cbe-9e61efa68e49 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.699267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 940/1876] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:31.700581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.700864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.701171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.703881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] RBAC: Authorizing `identity:create_grant(project_id=240ac545cce3449ebac5a79528297842, user_id=f202e4fff4be498bba5c022732bf3531, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.706971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.720756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:31.722122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.725434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 937/1877] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:31 2022] PUT /identity/v3/projects/240ac545cce3449ebac5a79528297842/users/f202e4fff4be498bba5c022732bf3531/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:31.726597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.728846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.746802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:31.797936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 941/1878] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:31.797936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.811314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11870ef5-0f73-4dd8-b70d-2bab43647b94 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.812432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff81206-b062-4a11-8769-00e8e263a61a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.822743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.822871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.822991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.822991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.823161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.823247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.823330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.823330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] PATH_INFO: `/v3/projects/dfec2c01d6544b57a04152dc20ba6456` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.823486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.823570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfec2c01d6544b57a04152dc20ba6456)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.823570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.823756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.836825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 942/1879] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:31.837854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.849290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80f0c-31be-49d2-9444-bbc3dbd84f49 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.854914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.855791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.856182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.856513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.857315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.859089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.870935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 943/1880] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:31.871943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.883195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515883c4-435f-4d31-86c9-cf8fec7808a4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:31.885806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfec2c01d6544b57a04152dc20ba6456', 'request_id': 'req-cb042856-59f0-4f1a-988a-5a6a0ab95700'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.891714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfec2c01d6544b57a04152dc20ba6456', 'request_id': 'req-cb042856-59f0-4f1a-988a-5a6a0ab95700'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.898538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfec2c01d6544b57a04152dc20ba6456', 'request_id': 'req-cb042856-59f0-4f1a-988a-5a6a0ab95700'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.913917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] The token cache is being invalidate because project dfec2c01d6544b57a04152dc20ba6456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:31.914602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.915279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:31.916978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 938/1881] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:31 2022] DELETE /identity/v3/projects/dfec2c01d6544b57a04152dc20ba6456 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:31.917742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.921397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.960914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:31.960914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:31.961269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:31.961624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:31.962522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:31.962791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:31.964396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:31.976787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 944/1882] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:31.977707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:31.981082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:31.995144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a969aef-e380-48c3-9131-328e2250c936 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.000421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042856-59f0-4f1a-988a-5a6a0ab95700 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.000867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.001350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.001726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.001947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] PATH_INFO: `/v3/projects/240ac545cce3449ebac5a79528297842/users/f202e4fff4be498bba5c022732bf3531/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.004149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=240ac545cce3449ebac5a79528297842, user_id=f202e4fff4be498bba5c022732bf3531, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.006304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3f6ab-ab5d-426f-a0cb-8fc323fa3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.007128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.007339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3f6ab-ab5d-426f-a0cb-8fc323fa3649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.007632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3f6ab-ab5d-426f-a0cb-8fc323fa3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.007913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3f6ab-ab5d-426f-a0cb-8fc323fa3649 admin admin] PATH_INFO: `/v3/projects/6510a51cc140427c96d6246e689001ad/users/a32990382a2a43e5bda8012422bad826/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.035906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3f6ab-ab5d-426f-a0cb-8fc323fa3649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6510a51cc140427c96d6246e689001ad, user_id=a32990382a2a43e5bda8012422bad826, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.038709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3f6ab-ab5d-426f-a0cb-8fc323fa3649 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.059743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 939/1883] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:31 2022] PUT /identity/v3/projects/6510a51cc140427c96d6246e689001ad/users/a32990382a2a43e5bda8012422bad826/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:32.062381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b57016-46ae-4a45-b802-d62b40987987 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.063013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b57016-46ae-4a45-b802-d62b40987987 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.063456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b57016-46ae-4a45-b802-d62b40987987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.089364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-13b57016-46ae-4a45-b802-d62b40987987 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:32.091096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-13b57016-46ae-4a45-b802-d62b40987987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.128285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:32.142040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 945/1884] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:31 2022] PUT /identity/v3/projects/240ac545cce3449ebac5a79528297842/users/f202e4fff4be498bba5c022732bf3531/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:32.142973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.153841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.199913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:32.218625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 940/1885] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:32.218625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1d1d1-3f55-40c7-a483-910428f98b72 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.218625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1d1d1-3f55-40c7-a483-910428f98b72 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.218920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1d1d1-3f55-40c7-a483-910428f98b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.252863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a8f1d1d1-3f55-40c7-a483-910428f98b72 None None] MFA Rules not processed for user `a32990382a2a43e5bda8012422bad826`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:32.253646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc9fda-2c26-4b1f-a9b8-801fb716ae7f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.254975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a8f1d1d1-3f55-40c7-a483-910428f98b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.259717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0c968-7a79-40a6-9968-852b71757709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.260978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c968-7a79-40a6-9968-852b71757709 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.261264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c968-7a79-40a6-9968-852b71757709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.261593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0c968-7a79-40a6-9968-852b71757709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.262355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0c968-7a79-40a6-9968-852b71757709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.265020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0c968-7a79-40a6-9968-852b71757709 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.305728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 946/1886] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:32.307197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.307589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.308093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.340108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] MFA Rules not processed for user `f202e4fff4be498bba5c022732bf3531`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:32.341700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.364833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 941/1887] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:32.366621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.372973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.373252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.400480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:32.401439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.456788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 947/1888] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:32.458384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.481938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 942/1889] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:32.481938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.481938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.547376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea967afc-f773-4424-a681-f63a35b20432 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.553981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.554899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.555190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.555466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.556342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.558448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.564125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eef4d-e5d1-4cf5-beef-d68ff7f953c5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.568635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.569314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.569586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.569870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.579821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:32.583564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 948/1890] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:32.583564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.583564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.624621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:32.647509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df9b31-e68e-4c59-aeb6-577ce7875bc6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.648731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.650196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.651417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.652072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.652453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.652740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.659861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 943/1891] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:32.660501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.663231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.664652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.671713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b9f92-b711-4bc8-ab12-efdc6f04aee9 service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.677041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.677794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.678150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.678527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.679341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:32.679783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.681448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.685200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 949/1892] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:32.695243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.695403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 944/1893] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:32.696475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.699657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.707950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60e7e-ad57-4f87-beba-349eaa9d2d78 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.714359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.715371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.715930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.716431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.717463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.719364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.731635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a64c6-bb39-45af-a6a7-8fc1ae0b93b9 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.735600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 945/1894] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:32.736501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.741358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.743715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.744359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.744712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] PATH_INFO: `/v3/users/eb9ab49f6f27456ba9fa60842abaa78d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.748682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9ab49f6f27456ba9fa60842abaa78d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.749516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c95db-521d-4b2c-bf47-e7aafc2286a3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.752367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.755149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.755883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.756207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.756526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.757296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.759637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.798343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 946/1895] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:32.799159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.820563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9ab49f6f27456ba9fa60842abaa78d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:32.828034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9ab49f6f27456ba9fa60842abaa78d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:32.828776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9ab49f6f27456ba9fa60842abaa78d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:32.836068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9ab49f6f27456ba9fa60842abaa78d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:32.836945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9ab49f6f27456ba9fa60842abaa78d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:32.856651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 950/1896] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:32 2022] DELETE /identity/v3/users/eb9ab49f6f27456ba9fa60842abaa78d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:32.857499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.858877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.878026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b027b-0251-4eff-a2fe-bd5835458df8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.925110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38eb5-0b4c-4033-8b5c-f3be46802b3e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.929975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.930822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.930938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.931210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.934143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.949386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.950197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.950618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.951375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.951847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.953679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.966873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 947/1897] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:32.970947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.973466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:32.986582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b7bfc-face-4bb1-b7c9-b1ddb16c5885 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.992616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.993316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.993603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.993881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.994614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.996610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.003689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:33.007355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.008793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511dce4-4bbb-4874-8769-83a3f3e72e0d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.018759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 951/1898] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:33.027300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 948/1899] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:32 2022] POST /identity/v3/users => generated 283 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:33.028050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.029929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:33.032027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.032320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.032600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.042764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:33.048041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40e12-ac50-4a29-b28a-a2bb61fd78a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.058676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e7b48-2145-47b4-8528-a27562942316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.060096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e7b48-2145-47b4-8528-a27562942316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.060647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e7b48-2145-47b4-8528-a27562942316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.061273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e7b48-2145-47b4-8528-a27562942316 admin admin] PATH_INFO: `/v3/projects/3123f2743de54dc8ba6119478d651ed1/users/523b826d7a5440c4b4bce8c593bb2171/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.064978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:33.066254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:33.075863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 952/1900] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:33.076690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.094852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e7b48-2145-47b4-8528-a27562942316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3123f2743de54dc8ba6119478d651ed1, user_id=523b826d7a5440c4b4bce8c593bb2171, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.098468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e7b48-2145-47b4-8528-a27562942316 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.115520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cb49-5381-408f-89e0-b1468673053a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.142698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 949/1901] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:33 2022] PUT /identity/v3/projects/3123f2743de54dc8ba6119478d651ed1/users/523b826d7a5440c4b4bce8c593bb2171/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:33.148588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.148814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.149219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.205249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] MFA Rules not processed for user `523b826d7a5440c4b4bce8c593bb2171`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:33.207335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:33.288509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.289582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.289873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.290148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.291135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.294069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.319613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 953/1902] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:33.321248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.324603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:33.338288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 950/1903] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:33.339452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.352233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406814bb-737d-4847-91d2-a8cd4ce0cc58 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.356959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.357624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.357921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.358334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.359081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.360707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.372240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 951/1904] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:33.372760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.384826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c223c-38df-49f5-9bde-dbcf9f468423 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.389808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.390580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.390892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.391132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.391823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.393743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.400172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5e259-a351-4f71-93a7-fa100235304a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.404584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.405774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.406064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.406374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.417529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.419078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.427162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 952/1905] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:33.428249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.440574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 954/1906] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:33.454562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.479832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74522970-8b1d-47fd-ab80-364ff3d5a8b5 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.541602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb74e-2688-4e43-98b1-ba5130f8da21 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.550963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1829-c7fd-430f-8be5-35ff63d18889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.551756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1829-c7fd-430f-8be5-35ff63d18889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.552047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1829-c7fd-430f-8be5-35ff63d18889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.552348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1829-c7fd-430f-8be5-35ff63d18889 admin admin] PATH_INFO: `/v3/projects/e0d537e4ff9c40ad98ca63c76b32d419/users/a3e64426b4d5489bb4ada08839310054/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.584414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1829-c7fd-430f-8be5-35ff63d18889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d537e4ff9c40ad98ca63c76b32d419, user_id=a3e64426b4d5489bb4ada08839310054, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.588146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1829-c7fd-430f-8be5-35ff63d18889 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.618382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 953/1907] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:33 2022] PUT /identity/v3/projects/e0d537e4ff9c40ad98ca63c76b32d419/users/a3e64426b4d5489bb4ada08839310054/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:33.629159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.629669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.631871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.647814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.650952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.650952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.650952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.651667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:33.653938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.660711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.699590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] MFA Rules not processed for user `a3e64426b4d5489bb4ada08839310054`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:33.701389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:33.727138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 955/1908] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:33.731930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.752274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998e3e1-2d6f-4175-a257-ff6129a65c5e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.792327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:33.859863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 954/1909] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:33.870140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.874196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.875188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.876814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.879233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.880605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.886915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1107030-f27d-46c2-8ed0-92d7aa8db877 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.890944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.903911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.910239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.910729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.911025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.911737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 956/1910] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:33.911969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.912841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.913941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.927280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55b959-767d-40f9-8306-8702c3750693 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.934876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.935752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.936047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.936786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] PATH_INFO: `/v3/projects/33b4e7c58261498a8324d7b8effbb097/users/436d18f72765469f9abadcdc9d65bf7e/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.954745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 955/1911] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:33.956687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.963220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b4e7c58261498a8324d7b8effbb097, user_id=436d18f72765469f9abadcdc9d65bf7e, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.968249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.994796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 957/1912] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:33 2022] PUT /identity/v3/projects/33b4e7c58261498a8324d7b8effbb097/users/436d18f72765469f9abadcdc9d65bf7e/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:34.000517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.120960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8e9d9-9b90-4a94-8b71-570be5cc51ee admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.159381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95239ac4-6275-4978-a7e2-1510a378206f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.167826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.168586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.168929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.169755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.171431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.177611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.202836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 958/1913] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:34.208006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.228731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeaee3-8b00-48d6-9bfd-d4f2513f29d0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.237058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.237979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.247101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.247101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] PATH_INFO: `/v3/projects/33b4e7c58261498a8324d7b8effbb097/users/436d18f72765469f9abadcdc9d65bf7e/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.247101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b4e7c58261498a8324d7b8effbb097, user_id=436d18f72765469f9abadcdc9d65bf7e, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.247101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.265313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 959/1914] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:34 2022] PUT /identity/v3/projects/33b4e7c58261498a8324d7b8effbb097/users/436d18f72765469f9abadcdc9d65bf7e/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:34.271269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.278366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.295444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb95346-cd8c-4a0b-8082-9ec10e2ef2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.296292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb95346-cd8c-4a0b-8082-9ec10e2ef2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.297290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb95346-cd8c-4a0b-8082-9ec10e2ef2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.297587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb95346-cd8c-4a0b-8082-9ec10e2ef2fb admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.298325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb95346-cd8c-4a0b-8082-9ec10e2ef2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.304090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb95346-cd8c-4a0b-8082-9ec10e2ef2fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.355405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 956/1915] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:33 2022] POST /identity/v3/users => generated 288 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:34.356793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.368788 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.370920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.392179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9255-ec05-4a8e-8f40-ac963841661c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.408191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.410274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.412147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.412273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:34.412790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] PATH_INFO: `/v3/projects/fc50b737243549c085a630da96da8a47` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.415519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc50b737243549c085a630da96da8a47)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.421321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.449989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] MFA Rules not processed for user `436d18f72765469f9abadcdc9d65bf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:34.451368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.476545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:34.559896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc50b737243549c085a630da96da8a47', 'request_id': 'req-16291447-4dbb-4952-a6d5-28e77d99a1bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.569230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc50b737243549c085a630da96da8a47', 'request_id': 'req-16291447-4dbb-4952-a6d5-28e77d99a1bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.573454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 957/1916] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:34.576291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc50b737243549c085a630da96da8a47', 'request_id': 'req-16291447-4dbb-4952-a6d5-28e77d99a1bb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.580213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.600539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fe22c-0c31-4206-bc5a-492617f2cceb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.602580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] The token cache is being invalidate because project fc50b737243549c085a630da96da8a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:34.602887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.603646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.608723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 960/1917] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:34 2022] DELETE /identity/v3/projects/fc50b737243549c085a630da96da8a47 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:34.608723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.608723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.707531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.708155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.708441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.708755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.709593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.712982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.716954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16291447-4dbb-4952-a6d5-28e77d99a1bb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.729573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.731493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.731493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.731923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.735590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.746026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 958/1918] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:34.747047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.750289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.764349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fede211-5e93-40ae-930c-ee45a798d3f4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:34.770596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:34.771508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:34.772007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:34.772309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] PATH_INFO: `/v3/users/69c7036121bd4c0faf1762f72a56a742` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:34.773588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c7036121bd4c0faf1762f72a56a742)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.775879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.845928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c7036121bd4c0faf1762f72a56a742'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.852580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:34.854019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:34.861664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c7036121bd4c0faf1762f72a56a742'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.862808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c7036121bd4c0faf1762f72a56a742'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.863873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c7036121bd4c0faf1762f72a56a742'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.866822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 961/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:34.867689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.869463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.884393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c7036121bd4c0faf1762f72a56a742'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:34.918850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 959/1920] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:34 2022] DELETE /identity/v3/users/69c7036121bd4c0faf1762f72a56a742 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:34.919992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:34.922005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:34.931264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:34.935570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc5275-6127-495e-975b-8be27efa5198 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:35.014676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177acfea-cc0f-4c6b-938e-a39b0cf488d2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:35.029009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:35.029009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.029009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.029009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] PATH_INFO: `/v3/users/523b826d7a5440c4b4bce8c593bb2171` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.034062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] RBAC: Authorizing `identity:delete_user(user_id=523b826d7a5440c4b4bce8c593bb2171)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:35.036991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:35.130953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523b826d7a5440c4b4bce8c593bb2171'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.153982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523b826d7a5440c4b4bce8c593bb2171'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.155486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523b826d7a5440c4b4bce8c593bb2171'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.156561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523b826d7a5440c4b4bce8c593bb2171'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.172526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d95b739-a43f-4053-b021-7a369268caad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523b826d7a5440c4b4bce8c593bb2171'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.202254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 960/1921] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:34 2022] DELETE /identity/v3/users/523b826d7a5440c4b4bce8c593bb2171 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:35.207730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.209267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.209725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.216051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:35.218211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.218665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.219016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] PATH_INFO: `/v3/projects/23de43e501374a9894f368abcbac2c73/users/7bbb5bfd153c44698ddaeef79ec7202a/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.223382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:35.262708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:35.266013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.271453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] RBAC: Authorizing `identity:create_grant(project_id=23de43e501374a9894f368abcbac2c73, user_id=7bbb5bfd153c44698ddaeef79ec7202a, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:35.276515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:35.302961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 962/1922] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:34 2022] PUT /identity/v3/projects/23de43e501374a9894f368abcbac2c73/users/7bbb5bfd153c44698ddaeef79ec7202a/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:35.308624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:35.311549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.446904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 961/1923] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:35.475088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:35.476479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a3195-d91f-4377-aab4-70e5750190de admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:35.477435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.516424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:35.519940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.521199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.521632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.523000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:35.529673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:35.581550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:35.588626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 963/1924] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:35.589876 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:35.595701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.622400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae5e7-e843-435c-8abd-69509d55ab1c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:35.629615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:35.630962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.631358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.631762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] PATH_INFO: `/v3/projects/e2a47b4fee094ca7ae00b90c19583a2f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.633365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a47b4fee094ca7ae00b90c19583a2f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:35.635680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d54e-c668-4cba-a60d-29d91c471c5d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:35.644537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:35.696994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:35.697771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.698064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.698370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.708358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:35.708509 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a47b4fee094ca7ae00b90c19583a2f', 'request_id': 'req-143030c5-d009-4df6-a767-145133daf827'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.709845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:35.714153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a47b4fee094ca7ae00b90c19583a2f', 'request_id': 'req-143030c5-d009-4df6-a767-145133daf827'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.719715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 962/1925] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:35.720698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:35.722443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a47b4fee094ca7ae00b90c19583a2f', 'request_id': 'req-143030c5-d009-4df6-a767-145133daf827'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.732970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc435a-8138-4302-ad1f-767d94706435 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:35.744642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] The token cache is being invalidate because project e2a47b4fee094ca7ae00b90c19583a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:35.744907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.746503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-143030c5-d009-4df6-a767-145133daf827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:35.748277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 964/1926] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:35 2022] DELETE /identity/v3/projects/e2a47b4fee094ca7ae00b90c19583a2f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:35.753936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520714-c147-470d-9663-113af9d6497a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.754336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520714-c147-470d-9663-113af9d6497a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.754690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520714-c147-470d-9663-113af9d6497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.778613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-69520714-c147-470d-9663-113af9d6497a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:35.780242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-69520714-c147-470d-9663-113af9d6497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.808189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17768508-ac3d-4427-b63f-e6ebb58c21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:35.809482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768508-ac3d-4427-b63f-e6ebb58c21ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.809743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768508-ac3d-4427-b63f-e6ebb58c21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.810022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768508-ac3d-4427-b63f-e6ebb58c21ca admin admin] PATH_INFO: `/v3/projects/23de43e501374a9894f368abcbac2c73/users/7bbb5bfd153c44698ddaeef79ec7202a/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.814070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17768508-ac3d-4427-b63f-e6ebb58c21ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=23de43e501374a9894f368abcbac2c73, user_id=7bbb5bfd153c44698ddaeef79ec7202a, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:35.819654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17768508-ac3d-4427-b63f-e6ebb58c21ca admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:35.833693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 963/1927] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:35 2022] PUT /identity/v3/projects/23de43e501374a9894f368abcbac2c73/users/7bbb5bfd153c44698ddaeef79ec7202a/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:35.844559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.844900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.845293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.866138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 965/1928] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:35.868893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:35.871845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:35.871845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:35.880467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:35.886450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] MFA Rules not processed for user `7bbb5bfd153c44698ddaeef79ec7202a`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:35.888192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.898963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:35.900172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:35.973061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 966/1929] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:35.979292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:35.996130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de4bd7-7ac0-4538-ab9a-5abc8a540b42 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.004705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.005736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.006034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.006464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.007655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:36.007655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.009031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:36.009501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.022934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 964/1930] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:36.027573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 967/1931] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:36.031113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.039358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.041640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:36.043800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d600d7a-83c6-4f43-a378-6d7b6f0b7fa7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.052398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.053323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.053742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.054274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.055224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.057599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.096864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 965/1932] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:36 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:36.096864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.096864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:36.139651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fb1ba-d34b-44b0-a078-c9250779d2e2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.182245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeb1b7-f8ce-43a0-8493-d9fcd24f2ffc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.188219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.189099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.189389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.189670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] PATH_INFO: `/v3/projects/3123f2743de54dc8ba6119478d651ed1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.191537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3123f2743de54dc8ba6119478d651ed1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.193458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.205107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.205985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.206492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.206878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.266945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3123f2743de54dc8ba6119478d651ed1', 'request_id': 'req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.276987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3123f2743de54dc8ba6119478d651ed1', 'request_id': 'req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.285821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3123f2743de54dc8ba6119478d651ed1', 'request_id': 'req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.307715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] The token cache is being invalidate because project 3123f2743de54dc8ba6119478d651ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:36.308017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.308748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.314475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 966/1933] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:36 2022] DELETE /identity/v3/projects/3123f2743de54dc8ba6119478d651ed1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:36.315832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.317544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:36.332540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:36.336196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.338631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.355822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 968/1934] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:36.365156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.377220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7113fc-1d13-4cb9-9667-16b8163426a9 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.438992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd9d5-9f1b-4591-9d37-5c2ba2d9edc4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.446260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.447084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.447197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.447480 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.448576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.450666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.478539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:36.480936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.481827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.482077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.482478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] PATH_INFO: `/v3/users/436d18f72765469f9abadcdc9d65bf7e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.483803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436d18f72765469f9abadcdc9d65bf7e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.485451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 967/1935] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:36 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:36.485733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.489149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.501691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:36.558043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436d18f72765469f9abadcdc9d65bf7e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.571390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436d18f72765469f9abadcdc9d65bf7e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.572239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436d18f72765469f9abadcdc9d65bf7e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.584127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436d18f72765469f9abadcdc9d65bf7e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.585291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436d18f72765469f9abadcdc9d65bf7e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:36.623683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 969/1936] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:36 2022] DELETE /identity/v3/users/436d18f72765469f9abadcdc9d65bf7e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:36.630139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.631639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:36.694479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6352d5-bc01-44f9-8547-f6e213c980ad admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.711595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a8391-79da-41dc-8100-015e81d0b044 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.718317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36aaca-9dde-4b22-b86b-01a053cd37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.719072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36aaca-9dde-4b22-b86b-01a053cd37fa admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.719575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36aaca-9dde-4b22-b86b-01a053cd37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.719960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36aaca-9dde-4b22-b86b-01a053cd37fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.720879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36aaca-9dde-4b22-b86b-01a053cd37fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.724489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36aaca-9dde-4b22-b86b-01a053cd37fa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.751022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 970/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:36.753630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02366a-53e1-47a3-81c5-85d00e1bb111 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.753957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02366a-53e1-47a3-81c5-85d00e1bb111 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.754269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02366a-53e1-47a3-81c5-85d00e1bb111 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.755842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 971/1938] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:10:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:10:36.756800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02366a-53e1-47a3-81c5-85d00e1bb111 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:36.803224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02366a-53e1-47a3-81c5-85d00e1bb111 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:36.819137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46b0d8-4aa7-40c5-b066-88fb94b0a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.819832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b0d8-4aa7-40c5-b066-88fb94b0a707 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.820118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b0d8-4aa7-40c5-b066-88fb94b0a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.821068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46b0d8-4aa7-40c5-b066-88fb94b0a707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.821321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b0d8-4aa7-40c5-b066-88fb94b0a707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:36.826187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46b0d8-4aa7-40c5-b066-88fb94b0a707 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:36.839228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:36.855304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:36.856005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.856294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.856784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 972/1939] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:36.861122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.863678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:36.864141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:36.864308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:36.866582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:36.919267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:36.920706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:37.014596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.016199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.041723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 968/1940] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:37.044013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.077453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7635-725f-47a9-8da6-54afea136c07 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:37.089120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dfa19-97e1-4112-9a38-4326d6017567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:37.092308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dfa19-97e1-4112-9a38-4326d6017567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.094581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dfa19-97e1-4112-9a38-4326d6017567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.094988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dfa19-97e1-4112-9a38-4326d6017567 admin admin] PATH_INFO: `/v3/projects/1c8bc078a59948dbae4e330ca70d834c/users/6a79068b6a574256b35ca19e0d6a2041/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.116652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 973/1941] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:10:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:37.136635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dfa19-97e1-4112-9a38-4326d6017567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8bc078a59948dbae4e330ca70d834c, user_id=6a79068b6a574256b35ca19e0d6a2041, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.141812 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dfa19-97e1-4112-9a38-4326d6017567 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.197596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.200834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:37.202439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 969/1942] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:37 2022] PUT /identity/v3/projects/1c8bc078a59948dbae4e330ca70d834c/users/6a79068b6a574256b35ca19e0d6a2041/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:37.214891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.215309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.215690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.265721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495dbaa-e905-42cb-bd85-95cfc774283e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:37.344263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] MFA Rules not processed for user `6a79068b6a574256b35ca19e0d6a2041`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:37.348164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:37.426347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:37.462172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:37.465630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.466177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.466770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.476815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 970/1943] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:37.477688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.479390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:37.484137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.486493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.516821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 974/1944] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:37.518203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.595599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48991f4c-d88a-4288-9b09-7c70ef7af857 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:37.613206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:37.614063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.614300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.614620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] PATH_INFO: `/v3/projects/33b4e7c58261498a8324d7b8effbb097` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.616765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b4e7c58261498a8324d7b8effbb097)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.618817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.702064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e011-7fa0-4071-ba90-4a93b05ca6ed service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:37.711491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:37.712381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.712810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.713258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.714172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.716477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.773168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b4e7c58261498a8324d7b8effbb097', 'request_id': 'req-96d30021-fad7-4fc1-a799-82324782aca0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:37.779807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b4e7c58261498a8324d7b8effbb097', 'request_id': 'req-96d30021-fad7-4fc1-a799-82324782aca0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:37.784496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 975/1945] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:37 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:37.788728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.789129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b4e7c58261498a8324d7b8effbb097', 'request_id': 'req-96d30021-fad7-4fc1-a799-82324782aca0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:37.795052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:37.816526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] The token cache is being invalidate because project 33b4e7c58261498a8324d7b8effbb097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:37.816808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:37.817664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-96d30021-fad7-4fc1-a799-82324782aca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:37.821028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 971/1946] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:37 2022] DELETE /identity/v3/projects/33b4e7c58261498a8324d7b8effbb097 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:37.829193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01eb61-46b9-440c-8938-03f5883c739e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.829505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01eb61-46b9-440c-8938-03f5883c739e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.829932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01eb61-46b9-440c-8938-03f5883c739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.861760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2f01eb61-46b9-440c-8938-03f5883c739e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:37.864817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2f01eb61-46b9-440c-8938-03f5883c739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:37.907407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611352c-d0e8-4534-b9d4-66549cbfc806 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:37.925192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:37.926312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.926486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.926707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.927418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.930935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.974293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 972/1947] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:37.978582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.978883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.979171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.986348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 976/1948] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:37 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:37.987635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:37.991063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.997491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:38.004503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:38.005835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:38.022632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 973/1949] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:38.026393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.042729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e0d0-4e00-40e1-a512-2ce4bc28a95f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.048907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be244f53-64a1-430f-a301-e431f4401e30 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.056174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.056856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.057266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.057573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.058918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.060804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.069773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.070413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.070692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.071029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.071991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:38.072307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.074067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.087743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 974/1950] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:10:38.092621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.104251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 977/1951] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:38.105177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.120258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9617203-c0ed-4602-9a10-bf0d3fac2d5a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.123915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730aaf01-b061-47d8-896b-944e9735b0bb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.131662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.132337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.134519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.135401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.136673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.138397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.141002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.141293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.141575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] PATH_INFO: `/v3/projects/369f3847003d4c1b97c48b90596aeb87/users/67420cc2609043de8dddef6c04b465c1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.144606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.171488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369f3847003d4c1b97c48b90596aeb87, user_id=67420cc2609043de8dddef6c04b465c1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.174674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.201857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 978/1952] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:38 2022] PUT /identity/v3/projects/369f3847003d4c1b97c48b90596aeb87/users/67420cc2609043de8dddef6c04b465c1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:38.205525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.215080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 975/1953] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:38 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:38.219514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.287674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b7c5d-dfe0-4e0d-8f77-fbf704dce570 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.324807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15337ab1-025f-45a2-a3c8-23bd00b94118 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.339100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.342236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.344489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.345726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.348791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.355250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.370692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.372495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.373615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.374613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.375366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.377714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.390011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:38.406184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 976/1955] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:38 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:38.406374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 979/1955] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:38.407267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.414967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.421343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e056e-cea6-4429-b89e-666b08800b36 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.427716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ab9f1-e16f-42c5-baaa-59375ad24022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.428666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ab9f1-e16f-42c5-baaa-59375ad24022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.428900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ab9f1-e16f-42c5-baaa-59375ad24022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.429332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ab9f1-e16f-42c5-baaa-59375ad24022 admin admin] PATH_INFO: `/v3/projects/369f3847003d4c1b97c48b90596aeb87/users/67420cc2609043de8dddef6c04b465c1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.431543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ab9f1-e16f-42c5-baaa-59375ad24022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369f3847003d4c1b97c48b90596aeb87, user_id=67420cc2609043de8dddef6c04b465c1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.432009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686ff74-19b2-463c-83a4-a9e1320cac0d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.434551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ab9f1-e16f-42c5-baaa-59375ad24022 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.446503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.447721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.457238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 977/1956] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:38 2022] PUT /identity/v3/projects/369f3847003d4c1b97c48b90596aeb87/users/67420cc2609043de8dddef6c04b465c1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:38.457435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.457435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.457435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.457435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.459676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.460049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.460606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.476203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 980/1957] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:38.477099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.488366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e9045-fa88-48fd-8197-c8885a810ef7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.495082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] MFA Rules not processed for user `67420cc2609043de8dddef6c04b465c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:38.496804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:38.572242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.573156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.573581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.573987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.575044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.577275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.598076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 981/1958] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:38.598076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.598883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 978/1959] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:38.612187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198f9e6-d45e-4b7f-8394-9402ffc46948 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.617317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.617808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f7f0f-0258-4c38-af8c-3a9324c068f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.618893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:38.619404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f7f0f-0258-4c38-af8c-3a9324c068f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.619887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f7f0f-0258-4c38-af8c-3a9324c068f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.620389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f7f0f-0258-4c38-af8c-3a9324c068f3 admin admin] PATH_INFO: `/v3/projects/4b848b3d35eb4b1ab44fab93508cfce0/users/0fe748bccc334b0cbd3fab94c9180f87/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.643878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f7f0f-0258-4c38-af8c-3a9324c068f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b848b3d35eb4b1ab44fab93508cfce0, user_id=0fe748bccc334b0cbd3fab94c9180f87, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.646875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f7f0f-0258-4c38-af8c-3a9324c068f3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.654194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:38.673110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 982/1960] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:38 2022] PUT /identity/v3/projects/4b848b3d35eb4b1ab44fab93508cfce0/users/0fe748bccc334b0cbd3fab94c9180f87/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:38.674706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.675158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.675376 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.688196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cafed-599a-439c-92e6-9b2b57b1d2b7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.708080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] MFA Rules not processed for user `0fe748bccc334b0cbd3fab94c9180f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:38.709475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:38.756991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.757705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.757994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.758787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.760325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:38.791104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 983/1961] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:38.795371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.857882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.859590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.860554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:38.870379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 979/1962] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:38.884107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb617c2e-3445-4fcb-98ed-7bff7f918386 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:38.889680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:38.890404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:38.890691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:38.890966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:38.891682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:38.894157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:38.928612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 984/1963] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:38 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:38.933183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:38.944883 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4575ef8-2254-432e-a7e9-2817794361ab service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.031048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.032342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.032471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.032776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.033523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.036461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.077652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 980/1964] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:38 2022] POST /identity/v3/users => generated 302 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:39.083047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:39.096262 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f6fc-8e84-4ec2-8421-0256235532c5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.102436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.103525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.103884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.104350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.105166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.107047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.119109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 985/1965] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:39.124911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:39.140889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735525d-13c6-4dda-950d-0dfef8585821 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.147282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.148321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.148644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.148995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] PATH_INFO: `/v3/projects/9ae29240ad4e44f085a34f4e538b8156/users/dbf23950f4f14375b58d20fba207b8ab/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.196665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae29240ad4e44f085a34f4e538b8156, user_id=dbf23950f4f14375b58d20fba207b8ab, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.196665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.208219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:39.217521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 981/1966] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:39 2022] PUT /identity/v3/projects/9ae29240ad4e44f085a34f4e538b8156/users/dbf23950f4f14375b58d20fba207b8ab/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:39.224393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:39.241479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ea54f-3d69-45d8-8f9d-21b22ce49e45 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.376156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96259-a727-4f76-b1c2-945f96b78c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.377321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96259-a727-4f76-b1c2-945f96b78c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.377894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96259-a727-4f76-b1c2-945f96b78c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.378416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96259-a727-4f76-b1c2-945f96b78c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.379423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96259-a727-4f76-b1c2-945f96b78c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.381327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96259-a727-4f76-b1c2-945f96b78c89 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.394951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 986/1967] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:39.399259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:39.414561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050fb04-8155-4eb2-b755-c5f7b2d88d9f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.425176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.426252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.426807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.427029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] PATH_INFO: `/v3/projects/9ae29240ad4e44f085a34f4e538b8156/users/dbf23950f4f14375b58d20fba207b8ab/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.429322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae29240ad4e44f085a34f4e538b8156, user_id=dbf23950f4f14375b58d20fba207b8ab, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.432648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.455932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 982/1968] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:39 2022] PUT /identity/v3/projects/9ae29240ad4e44f085a34f4e538b8156/users/dbf23950f4f14375b58d20fba207b8ab/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:39.457370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.457738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.458095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.494855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] MFA Rules not processed for user `dbf23950f4f14375b58d20fba207b8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:39.496235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:39.601001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 987/1969] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:39.615513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:39.678659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445401-dc27-4fab-be58-7da6782337e9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.682500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.683145 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.683442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.683718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.693475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.695003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.704741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 983/1970] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:39.763149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:39.764647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:39.777351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca143d7-f794-4b91-8200-d80cd824c1d3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:39.781360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b035d-55bd-4fd7-bf0e-b592b082c116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:39.782465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b035d-55bd-4fd7-bf0e-b592b082c116 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:39.782885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b035d-55bd-4fd7-bf0e-b592b082c116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:39.783172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b035d-55bd-4fd7-bf0e-b592b082c116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:39.832736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:39.846476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b035d-55bd-4fd7-bf0e-b592b082c116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:39.848430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b035d-55bd-4fd7-bf0e-b592b082c116 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:39.857774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 988/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:40.791637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:40.800511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:40.894006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d315a-f326-4f09-9071-0a4a8db8692d service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:40.899143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:40.901016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:40.901354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:40.901704 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] PATH_INFO: `/v3/users/a3e64426b4d5489bb4ada08839310054` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:40.903159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e64426b4d5489bb4ada08839310054)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:40.905316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:40.968922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e64426b4d5489bb4ada08839310054'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:40.978157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e64426b4d5489bb4ada08839310054'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:40.983245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e64426b4d5489bb4ada08839310054'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:40.983245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e64426b4d5489bb4ada08839310054'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.002364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e64426b4d5489bb4ada08839310054'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.019724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 984/1972] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:40 2022] DELETE /identity/v3/users/a3e64426b4d5489bb4ada08839310054 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:41.026041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:41.026558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:41.026752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:41.044330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:41.045708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:41.111661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 989/1973] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:41.121615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:41.123072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:41.134711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:41.186689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c371159-3108-41a3-8b98-3ee136b39c66 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:41.191143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:41.191799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:41.192076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:41.192349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:41.201913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:41.203467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:41.213469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 985/1974] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:41.493812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:41.495374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:41.511280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10e8e-5855-4cfc-992b-9b36588f6ca8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:41.516285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:41.518495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:41.518964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:41.519242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] PATH_INFO: `/v3/projects/e0d537e4ff9c40ad98ca63c76b32d419` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:41.520710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d537e4ff9c40ad98ca63c76b32d419)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:41.523193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:41.579385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d537e4ff9c40ad98ca63c76b32d419', 'request_id': 'req-7829f94c-1589-4377-87ba-9adab3164cf0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.585933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d537e4ff9c40ad98ca63c76b32d419', 'request_id': 'req-7829f94c-1589-4377-87ba-9adab3164cf0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.593885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d537e4ff9c40ad98ca63c76b32d419', 'request_id': 'req-7829f94c-1589-4377-87ba-9adab3164cf0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.608488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] The token cache is being invalidate because project e0d537e4ff9c40ad98ca63c76b32d419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:41.608775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.609409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.611033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 990/1975] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:41 2022] DELETE /identity/v3/projects/e0d537e4ff9c40ad98ca63c76b32d419 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:41.615779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:41.625919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4758a6-4f1f-4cab-be8e-252611570bb2 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:41.726879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:41.728219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:41.730299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:41.730778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] PATH_INFO: `/v3/users/7bbb5bfd153c44698ddaeef79ec7202a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:41.736464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbb5bfd153c44698ddaeef79ec7202a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:41.740279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:41.817773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbb5bfd153c44698ddaeef79ec7202a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.826158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:41.828951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:41.843514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbb5bfd153c44698ddaeef79ec7202a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.845095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbb5bfd153c44698ddaeef79ec7202a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.845919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbb5bfd153c44698ddaeef79ec7202a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.870852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbb5bfd153c44698ddaeef79ec7202a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:41.898059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 986/1976] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:41 2022] DELETE /identity/v3/users/7bbb5bfd153c44698ddaeef79ec7202a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:41.907357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829f94c-1589-4377-87ba-9adab3164cf0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:41.941696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:42.009000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:42.015054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:42.015573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:42.015986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:42.019379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:42.109652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:42.111591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34cea-160a-407c-8520-5cdadee7dd40 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:42.123174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 991/1977] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:42.336165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:42.337794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:42.441416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:42.534072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e283f-da8c-49db-80c6-f3544b4969ea admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:42.541249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:42.544224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:42.544657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:42.545093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] PATH_INFO: `/v3/projects/23de43e501374a9894f368abcbac2c73` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:42.546982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23de43e501374a9894f368abcbac2c73)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:42.549671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:42.639506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23de43e501374a9894f368abcbac2c73', 'request_id': 'req-fc90eaf9-33a0-480d-b500-74ab4c284b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:42.645630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23de43e501374a9894f368abcbac2c73', 'request_id': 'req-fc90eaf9-33a0-480d-b500-74ab4c284b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:42.655582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23de43e501374a9894f368abcbac2c73', 'request_id': 'req-fc90eaf9-33a0-480d-b500-74ab4c284b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:42.680112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] The token cache is being invalidate because project 23de43e501374a9894f368abcbac2c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:42.680661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:42.681719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc90eaf9-33a0-480d-b500-74ab4c284b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:42.689250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 987/1978] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:42 2022] DELETE /identity/v3/projects/23de43e501374a9894f368abcbac2c73 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:42.690059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:42.691041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:42.691569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:42.719480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:42.722501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:42.835976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 992/1979] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:42.843949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:42.844767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:42.846086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:42.874993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:42.876352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:42.901108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 988/1980] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:42.907274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:42.920505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea678028-a947-4676-84a5-f257b95cc5ea None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:42.927066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:42.927824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:42.928114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:42.928441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:42.929219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:42.929802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:42.931481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:42.956135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 993/1981] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:10:42.957442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:42.968345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4688848-085d-44b9-8a38-335ab0f6b14a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:42.983540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:42.984413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:42.984705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:42.985000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:42.985728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:42.988871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.031036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 989/1982] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:42 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:43.035606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.048719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2115-69b4-480a-8d54-38e342ee6477 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.111443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.112706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.112994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.113275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.113980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.115918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.123774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:43.139183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 994/1983] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:43 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:43.143633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.155608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14279d1a-9f59-413c-986b-3a2a72a12978 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.161509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.162194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.162519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.162799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.163538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.165147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.181520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 990/1984] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:43.183293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.193285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee099-e1cd-4e51-83de-3fd90a7f28a9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.198303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa549e-291e-4a38-bac7-2ed3ce8a4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.198929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa549e-291e-4a38-bac7-2ed3ce8a4c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.199191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa549e-291e-4a38-bac7-2ed3ce8a4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.199471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa549e-291e-4a38-bac7-2ed3ce8a4c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.201718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa549e-291e-4a38-bac7-2ed3ce8a4c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.202764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa549e-291e-4a38-bac7-2ed3ce8a4c15 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.226577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 995/1985] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:43.232702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.244878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d2be0-d534-4b32-b44a-3ab176b26f40 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.250191 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.251659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.252233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.252517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] PATH_INFO: `/v3/projects/fdca8f9333b24d1d9c7c49a87df25566/users/e599ff187c144ac382a4de99109c8ae0/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.270060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdca8f9333b24d1d9c7c49a87df25566, user_id=e599ff187c144ac382a4de99109c8ae0, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.273917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.293361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 991/1986] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:43 2022] PUT /identity/v3/projects/fdca8f9333b24d1d9c7c49a87df25566/users/e599ff187c144ac382a4de99109c8ae0/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:43.306512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.306808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.307093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.342777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] MFA Rules not processed for user `e599ff187c144ac382a4de99109c8ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:43.351346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:43.458442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 996/1987] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:43.463551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.551520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:43.575079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeb029-b0ea-4514-b6a4-f3c78dd3fb4a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.581999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.583004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.583785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.584235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.585408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.587569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.620631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 992/1988] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:43 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:43.625144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.636543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0b38d-c0c2-40a0-9d47-548237bdb11c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.704651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.705496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.707190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.707561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.708348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.711100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.742449 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.744382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:43.747677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 997/1989] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:43 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:43.754783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.760194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6cb3d-3888-474b-a109-5441b28e11fb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.767141 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.768123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc881e9-c5c6-43ad-a18f-6c48a1f1fcba admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.768255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.769192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.769803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] PATH_INFO: `/v3/users/8abf00de915544fb9ca0c14b6d9998cf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.771085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abf00de915544fb9ca0c14b6d9998cf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.773375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.774779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.775616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.776050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.776497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.777668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.779461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.790417 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 998/1990] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:43.794698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.806589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddde460-4af5-4d82-a07c-65a56eecf051 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.816436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.818086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.818764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.819791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.822317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.825422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.842106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 999/1991] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:43.848257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:43.857745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abf00de915544fb9ca0c14b6d9998cf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:43.862426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07aa4ca-2791-412f-b570-2aa8f5d9a5b4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:43.866448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abf00de915544fb9ca0c14b6d9998cf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:43.867241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abf00de915544fb9ca0c14b6d9998cf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:43.868063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abf00de915544fb9ca0c14b6d9998cf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:43.868953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611b681-a2fc-4ae2-97ff-52722eb4906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:43.870643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611b681-a2fc-4ae2-97ff-52722eb4906d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.871057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611b681-a2fc-4ae2-97ff-52722eb4906d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.871545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611b681-a2fc-4ae2-97ff-52722eb4906d admin admin] PATH_INFO: `/v3/projects/94c803b1ca37412889242544817e009e/users/c20581a5c4024d85930154ef97848e83/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.889068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-47e92082-9b3d-4235-b367-b03127843021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abf00de915544fb9ca0c14b6d9998cf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:43.891505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611b681-a2fc-4ae2-97ff-52722eb4906d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c803b1ca37412889242544817e009e, user_id=c20581a5c4024d85930154ef97848e83, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:43.895219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611b681-a2fc-4ae2-97ff-52722eb4906d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:43.904831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 993/1992] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:43 2022] DELETE /identity/v3/users/8abf00de915544fb9ca0c14b6d9998cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:43.910170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.911071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1000/1993] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:43 2022] PUT /identity/v3/projects/94c803b1ca37412889242544817e009e/users/c20581a5c4024d85930154ef97848e83/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:43.912555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.912848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.923615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:43.923857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:43.924090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:43.934630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:43.935851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:43.950684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:43.955669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] MFA Rules not processed for user `c20581a5c4024d85930154ef97848e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:43.960214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.015463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 994/1994] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:44.016389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.017669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.042133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1fe85-1fea-4c1a-9de8-bb2b98fc53b0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.048162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.049050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.049347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.050414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] PATH_INFO: `/v3/users/0fe748bccc334b0cbd3fab94c9180f87` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.051631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe748bccc334b0cbd3fab94c9180f87)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.053748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.056186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1001/1995] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:44.059545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.066353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.129573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe748bccc334b0cbd3fab94c9180f87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:44.137637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:44.151720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe748bccc334b0cbd3fab94c9180f87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:44.152645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe748bccc334b0cbd3fab94c9180f87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:44.153319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe748bccc334b0cbd3fab94c9180f87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:44.167526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4c306-735f-468e-a0c4-4ca12862f4f3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.172945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.173611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.173949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.174174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.176071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.177907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe748bccc334b0cbd3fab94c9180f87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:44.193431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.195209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1686883-1ad6-4b33-9207-08c12a2364d9 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.200716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 995/1996] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:44 2022] DELETE /identity/v3/users/0fe748bccc334b0cbd3fab94c9180f87 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:44.201596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.203048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.206885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1002/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:44.208481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.208481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.208888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.242666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:44.244001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.349422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1003/1998] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:44.364987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.367570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:44.370431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0935b8-4aa1-4dc3-86bb-c36d80b0be1d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.383317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.384143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.384434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.384718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.386401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.389865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.490921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 996/1999] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:44 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:44.494629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.508758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:44.521432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676e6c8-479c-412f-96c3-c9debaf9b9ca None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.590375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.591182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.591567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.591953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.603588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabe3a2-349e-4260-8b6e-157bfd9d0653 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.610134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.614304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.614304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.614304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.616370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.616911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.618389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.623979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.648961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1004/2000] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:44.652117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 997/2001] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:44 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:44.658114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.672053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e93dd-6fba-4f52-a06d-5ddeccade878 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.684917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.685771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.686050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.686401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.687216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.689524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.710814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1005/2002] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:44.714814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.726570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a0824-c619-4c36-809c-457d9df60060 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.732644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.733937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.734117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.734436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] PATH_INFO: `/v3/projects/9235dee4fc6341fd988908c3637c7f4d/users/1dfbd759a709465b8489514c3f3b4a12/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.763045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9235dee4fc6341fd988908c3637c7f4d, user_id=1dfbd759a709465b8489514c3f3b4a12, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.766610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.790744 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 998/2003] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:44 2022] PUT /identity/v3/projects/9235dee4fc6341fd988908c3637c7f4d/users/1dfbd759a709465b8489514c3f3b4a12/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:44.792960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.817110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f77e96-50a4-4ccd-963d-4ebc8f72ce26 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.929399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161f423-21cf-47cc-a18d-705bbbe139ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.930863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161f423-21cf-47cc-a18d-705bbbe139ce admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.931250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161f423-21cf-47cc-a18d-705bbbe139ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.931629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161f423-21cf-47cc-a18d-705bbbe139ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.932551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161f423-21cf-47cc-a18d-705bbbe139ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.934274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161f423-21cf-47cc-a18d-705bbbe139ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:44.952648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1006/2004] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:44.956935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:44.969293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c6f4b-b179-4e24-9417-9f1d3435a903 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:44.974884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:44.976374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:44.976725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:44.977010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] PATH_INFO: `/v3/projects/9235dee4fc6341fd988908c3637c7f4d/users/1dfbd759a709465b8489514c3f3b4a12/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:44.979584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9235dee4fc6341fd988908c3637c7f4d, user_id=1dfbd759a709465b8489514c3f3b4a12, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:44.983715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.033458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 999/2005] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:44 2022] PUT /identity/v3/projects/9235dee4fc6341fd988908c3637c7f4d/users/1dfbd759a709465b8489514c3f3b4a12/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:45.036220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.036917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.037367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.067349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:45.069894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.077896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=3,keystone:INSERT=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:45.083124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] MFA Rules not processed for user `1dfbd759a709465b8489514c3f3b4a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:45.087133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.211748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96161b29-e5b9-488b-b2bd-00f92f48cbb2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:45.219308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:45.220168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.220503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.220785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] PATH_INFO: `/v3/projects/410b720b5d114842b5c5b751b35ce012` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.222121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410b720b5d114842b5c5b751b35ce012)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:45.224212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.233834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1007/2006] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:45.246548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:45.248322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.270510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dda0b6-7d1a-47ce-be2b-600c8f3bd562 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:45.275358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:45.276221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.276503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.276945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] PATH_INFO: `/v3/projects/4b848b3d35eb4b1ab44fab93508cfce0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.278135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b848b3d35eb4b1ab44fab93508cfce0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:45.280089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.290371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410b720b5d114842b5c5b751b35ce012', 'request_id': 'req-2665da8b-a443-4c74-9e2a-9f061b95a9c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.292159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:45.296571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410b720b5d114842b5c5b751b35ce012', 'request_id': 'req-2665da8b-a443-4c74-9e2a-9f061b95a9c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.303426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410b720b5d114842b5c5b751b35ce012', 'request_id': 'req-2665da8b-a443-4c74-9e2a-9f061b95a9c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.317548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] The token cache is being invalidate because project 410b720b5d114842b5c5b751b35ce012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:45.317903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.318497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.320196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1000/2007] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:45 2022] DELETE /identity/v3/projects/410b720b5d114842b5c5b751b35ce012 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:45.321085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:45.322441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.331202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b848b3d35eb4b1ab44fab93508cfce0', 'request_id': 'req-0b2f0362-277b-4446-8c18-7116a5e00dfe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.337168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b848b3d35eb4b1ab44fab93508cfce0', 'request_id': 'req-0b2f0362-277b-4446-8c18-7116a5e00dfe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.343673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b848b3d35eb4b1ab44fab93508cfce0', 'request_id': 'req-0b2f0362-277b-4446-8c18-7116a5e00dfe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.373487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] The token cache is being invalidate because project 4b848b3d35eb4b1ab44fab93508cfce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:45.377653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.378427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.382254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1008/2008] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:45 2022] DELETE /identity/v3/projects/4b848b3d35eb4b1ab44fab93508cfce0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:45.382868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:45.384193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.392707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665da8b-a443-4c74-9e2a-9f061b95a9c2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:45.451471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:45.451995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.452349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.452698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.455049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.467024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:45.472554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f0362-277b-4446-8c18-7116a5e00dfe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:45.479034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:45.479948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.480231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.480499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] PATH_INFO: `/v3/users/d295a6a15f11434aa069a93f464c9775` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.481879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d295a6a15f11434aa069a93f464c9775)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:45.483862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.541213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:45.543724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.544151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd295a6a15f11434aa069a93f464c9775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.555800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd295a6a15f11434aa069a93f464c9775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.557590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd295a6a15f11434aa069a93f464c9775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.559057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1001/2009] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:45.560015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:45.561988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.566933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd295a6a15f11434aa069a93f464c9775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.567722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd295a6a15f11434aa069a93f464c9775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.579985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de447-2ccb-48d1-9dce-7459e676f4bc service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:45.585748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:45.586614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.586969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.587442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] PATH_INFO: `/v3/users/dbf23950f4f14375b58d20fba207b8ab` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.588749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf23950f4f14375b58d20fba207b8ab)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:45.594499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.594691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1009/2010] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:45 2022] DELETE /identity/v3/users/d295a6a15f11434aa069a93f464c9775 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:45.672769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf23950f4f14375b58d20fba207b8ab'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.676167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:45.677690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.692244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf23950f4f14375b58d20fba207b8ab'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.695086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf23950f4f14375b58d20fba207b8ab'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.695970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf23950f4f14375b58d20fba207b8ab'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.704990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:45.736820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf23950f4f14375b58d20fba207b8ab'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:45.756912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5b7e-a559-4390-985f-d350adaad9fc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:45.759868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1002/2011] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:45 2022] DELETE /identity/v3/users/dbf23950f4f14375b58d20fba207b8ab => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:45.763832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:45.764516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:45.764839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:45.765106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:45.767146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:45.870420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:45.872374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:45.884574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1010/2012] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:46.179158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.182514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:46.339626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.342520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:46.350865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4373edb-f8e8-4d43-81fb-c38a126fe6b4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.366068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.367337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.367628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.367907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] PATH_INFO: `/v3/projects/ba598feb13d44b50a6ceb17d9577faea` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.371461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba598feb13d44b50a6ceb17d9577faea)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.375610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.402016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:46.493517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba598feb13d44b50a6ceb17d9577faea', 'request_id': 'req-950c67bb-247d-4c35-91b9-d6653dd184f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.501240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba598feb13d44b50a6ceb17d9577faea', 'request_id': 'req-950c67bb-247d-4c35-91b9-d6653dd184f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.505469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc750-00d1-4b7d-b2a9-72768df7dc54 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.508988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba598feb13d44b50a6ceb17d9577faea', 'request_id': 'req-950c67bb-247d-4c35-91b9-d6653dd184f7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.545301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] The token cache is being invalidate because project ba598feb13d44b50a6ceb17d9577faea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:46.546255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.546932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-950c67bb-247d-4c35-91b9-d6653dd184f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.552004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1003/2013] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:46 2022] DELETE /identity/v3/projects/ba598feb13d44b50a6ceb17d9577faea => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:46.557179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6abc-407d-4c87-b68a-9212e9c15e49 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.557477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6abc-407d-4c87-b68a-9212e9c15e49 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.558418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a6abc-407d-4c87-b68a-9212e9c15e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.584015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-523a6abc-407d-4c87-b68a-9212e9c15e49 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:46.585691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-523a6abc-407d-4c87-b68a-9212e9c15e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:46.597489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.598401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.598748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.599039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] PATH_INFO: `/v3/projects/9ae29240ad4e44f085a34f4e538b8156` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.600243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae29240ad4e44f085a34f4e538b8156)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.602148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.629234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:46.657348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae29240ad4e44f085a34f4e538b8156', 'request_id': 'req-6f4e68ec-648a-48a8-9907-678c78630e85'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.661739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1004/2014] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:46.664765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae29240ad4e44f085a34f4e538b8156', 'request_id': 'req-6f4e68ec-648a-48a8-9907-678c78630e85'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.669302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.669602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.669884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.672397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae29240ad4e44f085a34f4e538b8156', 'request_id': 'req-6f4e68ec-648a-48a8-9907-678c78630e85'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.686936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] The token cache is being invalidate because project 9ae29240ad4e44f085a34f4e538b8156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:46.687424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.688534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f4e68ec-648a-48a8-9907-678c78630e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:46.689827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:46.691163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1011/2015] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:46 2022] DELETE /identity/v3/projects/9ae29240ad4e44f085a34f4e538b8156 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:46.691679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:46.696742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e8eb-d767-4955-9439-75338d65a30f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.696886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e8eb-d767-4955-9439-75338d65a30f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.697154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e8eb-d767-4955-9439-75338d65a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.743434 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-95c5e8eb-d767-4955-9439-75338d65a30f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:46.744724 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-95c5e8eb-d767-4955-9439-75338d65a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:46.771651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1005/2016] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:46.775874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.788213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885520b7-2d0d-4405-9995-c2ffb17a6540 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.793423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.794136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.794528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.794702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.795618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:46.795727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.797611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.814841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1006/2017] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:46.819380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.831119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1012/2018] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:46.831272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b630-1419-4e34-94af-9d34df41ab23 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.836476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.837144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.837437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.837722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.838634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.839644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.839764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.840120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.841461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.859316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:46.860505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:46.870672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1013/2019] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:46.875067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.878053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1007/2020] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:46.882013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.884166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd31c9-c546-4296-8d84-971296395366 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.893475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:46.947332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.947942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.948326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.948498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.949217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:46.949525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.951130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.953084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23192b92-3eb3-4c93-8bcc-230e89602c9d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.957770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.958467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.958756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.959088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.959718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.961643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.963223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1014/2021] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:10:46.967492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.979313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb21f6-74a1-4027-b320-d54631fed43f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:46.985265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1008/2022] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:46.985392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:46.985392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:46.985392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:46.985392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:46.986022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:46.986476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:46.988515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:46.996695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326ee16-d11a-4ddc-b061-029451a8d4d9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.001749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.002494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.002752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.003031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.003766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.005355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.027969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1015/2023] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:46 2022] POST /identity/v3/projects => generated 407 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:47.031541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.035318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1009/2024] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:47.037080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.056371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7f5e-6519-4e5f-a7ab-b36b557a47db admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.060400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:47.131009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eefb70-0b56-42fb-9452-7f36d616948b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.134608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.135716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.136005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.136285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.136770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.137022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.137547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.137839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.138119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.138682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.138850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.141161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.149964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1010/2025] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:47.154125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.163834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1016/2026] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/users => generated 304 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:47.165278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63801-94a8-4dfc-898a-ebe70c5f02fe admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.167603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.170371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa302bc-a099-42dd-bf50-1cf0acdf47a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.171258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa302bc-a099-42dd-bf50-1cf0acdf47a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.171546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa302bc-a099-42dd-bf50-1cf0acdf47a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.171826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa302bc-a099-42dd-bf50-1cf0acdf47a9 admin admin] PATH_INFO: `/v3/projects/cbb2b50ced624cdea47c3424ecff5e7b/users/923f1e54248c47ddb764c9d6907eb1bf/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.177925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cd10b-dc33-4ecc-8525-b63d0ec6bfd6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.182804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.183465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.183760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.184033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.184906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.186543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.187666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa302bc-a099-42dd-bf50-1cf0acdf47a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb2b50ced624cdea47c3424ecff5e7b, user_id=923f1e54248c47ddb764c9d6907eb1bf, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.190916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa302bc-a099-42dd-bf50-1cf0acdf47a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.196963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1017/2027] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:47.201173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.206692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1011/2028] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:47 2022] PUT /identity/v3/projects/cbb2b50ced624cdea47c3424ecff5e7b/users/923f1e54248c47ddb764c9d6907eb1bf/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:47.215838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f001-94ce-4415-a807-3d6f141c1b62 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.218830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.219129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.219410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.257422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] MFA Rules not processed for user `923f1e54248c47ddb764c9d6907eb1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:47.258708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:47.303160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.303966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.304328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.304686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.305565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.307298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.319058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1018/2029] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:47.324678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.338147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:47.339152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f5f19-fc41-4f24-972b-dde0e0f7a940 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.345844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255efbe1-8e3b-426b-88a8-248a8c3ac3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.347458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255efbe1-8e3b-426b-88a8-248a8c3ac3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.347825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255efbe1-8e3b-426b-88a8-248a8c3ac3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.348160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255efbe1-8e3b-426b-88a8-248a8c3ac3c5 admin admin] PATH_INFO: `/v3/projects/5e71ad234fa841619393da06da7cec02/users/9fd2f766394046e8bf646396a14846bf/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.368274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255efbe1-8e3b-426b-88a8-248a8c3ac3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e71ad234fa841619393da06da7cec02, user_id=9fd2f766394046e8bf646396a14846bf, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.368869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1012/2030] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:47.371268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255efbe1-8e3b-426b-88a8-248a8c3ac3c5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.373925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.390899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fd6d7-7743-42b8-b7ed-6c1f2da7d424 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.391622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1019/2031] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:47 2022] PUT /identity/v3/projects/5e71ad234fa841619393da06da7cec02/users/9fd2f766394046e8bf646396a14846bf/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:47.404717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.406273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.406273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.442033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] MFA Rules not processed for user `9fd2f766394046e8bf646396a14846bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:47.443312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:47.481106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.482189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.482544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.482830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.483732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.485717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.530123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:47.532670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1013/2032] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:47.538363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.549685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1020/2033] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:47.555737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.578399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9183050-8c4f-46be-ba31-8480a315b512 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.634014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bddc5-9b33-4710-b460-1ad710487114 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.639736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.641171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.641466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.641765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.643032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.646346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.665980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.666828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.667188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.667585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.668640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.671714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.675606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1014/2034] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:47.679385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.690910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8643-c651-4af2-a63b-08d50c06d97c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.700535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.701249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.701570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.701986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.703366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.705358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.706955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1021/2035] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/projects => generated 409 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:47.711759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.723597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1015/2036] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:47.724682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.735143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f5943-37bf-47e1-9614-e43f756f2277 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.799227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:47.801129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238de4b-e113-4774-8b12-bde8f17e7f2b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:47.808031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.808814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.809218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.809596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.810656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.812859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.817924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:47.819262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:47.819464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:47.819749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] PATH_INFO: `/v3/projects/e74127e316344112a47045f230817ebe/users/10f154891abf4894a503e5247bc9ec19/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:47.845550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74127e316344112a47045f230817ebe, user_id=10f154891abf4894a503e5247bc9ec19, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:47.848574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:47.865057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1022/2037] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:47 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:47.865867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.874981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1016/2038] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:47 2022] PUT /identity/v3/projects/e74127e316344112a47045f230817ebe/users/10f154891abf4894a503e5247bc9ec19/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:47.880359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:47.886050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724a95b-afd4-4a79-b3cc-b2db39b462a0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.000111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b37d93-7f6b-4d52-bf68-3b842226d70a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.004365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.005499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.006424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.006927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.007658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.009712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.012766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.014899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.015304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.015691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.016814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.021909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.031651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1023/2039] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:48.037447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.038416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1017/2040] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:48.041776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.053263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae215661-889e-409a-bc2f-ff080a9f0f35 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.054189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece216c-2641-4ee0-9807-b21adda70aad admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.058248 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a007d2-0997-49fc-bf35-a030021e7a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.059140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a007d2-0997-49fc-bf35-a030021e7a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.059546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a007d2-0997-49fc-bf35-a030021e7a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.059836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a007d2-0997-49fc-bf35-a030021e7a92 admin admin] PATH_INFO: `/v3/projects/e74127e316344112a47045f230817ebe/users/10f154891abf4894a503e5247bc9ec19/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.059976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.060878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.061235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.061677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] PATH_INFO: `/v3/projects/61304cedd48b458ca9588c0120e9b7c9/users/b153b51f656a47e897ff635bf33fe76d/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.062062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a007d2-0997-49fc-bf35-a030021e7a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74127e316344112a47045f230817ebe, user_id=10f154891abf4894a503e5247bc9ec19, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.064215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:48.064780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a007d2-0997-49fc-bf35-a030021e7a92 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.078432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1018/2041] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:48 2022] PUT /identity/v3/projects/e74127e316344112a47045f230817ebe/users/10f154891abf4894a503e5247bc9ec19/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:48.085841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61304cedd48b458ca9588c0120e9b7c9, user_id=b153b51f656a47e897ff635bf33fe76d, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.088640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.089058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.089384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.089733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.104050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1024/2042] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:48 2022] PUT /identity/v3/projects/61304cedd48b458ca9588c0120e9b7c9/users/b153b51f656a47e897ff635bf33fe76d/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:48.108956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.123621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] MFA Rules not processed for user `10f154891abf4894a503e5247bc9ec19`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:48.125193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:48.189086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fde1cc-7686-439d-b97f-32e606d3391e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.195538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.196243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.196579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.197232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.197754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.199732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.210166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1025/2043] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:48.214087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1019/2044] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:48.216325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.225082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f426-1014-4df9-a52e-1d5db2da5354 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.225969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.227393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:48.229978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6fa09-2275-4683-a24a-6bd197d605c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.230980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6fa09-2275-4683-a24a-6bd197d605c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.231328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6fa09-2275-4683-a24a-6bd197d605c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.231825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6fa09-2275-4683-a24a-6bd197d605c4 admin admin] PATH_INFO: `/v3/projects/61304cedd48b458ca9588c0120e9b7c9/users/b153b51f656a47e897ff635bf33fe76d/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.233856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6fa09-2275-4683-a24a-6bd197d605c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61304cedd48b458ca9588c0120e9b7c9, user_id=b153b51f656a47e897ff635bf33fe76d, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.236598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6fa09-2275-4683-a24a-6bd197d605c4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.247515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1026/2045] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:48 2022] PUT /identity/v3/projects/61304cedd48b458ca9588c0120e9b7c9/users/b153b51f656a47e897ff635bf33fe76d/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:48.258668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.259011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.259351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.284472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:48.289282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] MFA Rules not processed for user `b153b51f656a47e897ff635bf33fe76d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:48.290538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:48.300973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88138154-e2f3-4395-b7e2-86f734ebbbad None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.361798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.363104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.363395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.363678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.390178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1027/2046] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:48.436151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.437614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.447774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1020/2047] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:48.545229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.546835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:48.565633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27638cb-66de-47dd-9cf3-ca39b1e6f260 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.573734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.574703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.575201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.575653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.586774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.589243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.601940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1028/2048] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:48.885309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:48.895996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a14117-43d7-4fe2-af87-c8ef2e1040ca service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:48.900249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69050d5-73a8-40da-a210-74bc0760b028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:48.901148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69050d5-73a8-40da-a210-74bc0760b028 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:48.901633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69050d5-73a8-40da-a210-74bc0760b028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:48.902054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69050d5-73a8-40da-a210-74bc0760b028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:48.959859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69050d5-73a8-40da-a210-74bc0760b028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:48.961358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69050d5-73a8-40da-a210-74bc0760b028 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:48.970865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1021/2049] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:48 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:49.437189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:49.438816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:49.496638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:49.518310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf0c2f-d683-4dae-a272-6d6a03639c7e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:49.524453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:49.525633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:49.525752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:49.526033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] PATH_INFO: `/v3/users/e599ff187c144ac382a4de99109c8ae0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:49.527400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e599ff187c144ac382a4de99109c8ae0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:49.529725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:49.588386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e599ff187c144ac382a4de99109c8ae0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:49.595204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e599ff187c144ac382a4de99109c8ae0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:49.595854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e599ff187c144ac382a4de99109c8ae0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:49.604075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e599ff187c144ac382a4de99109c8ae0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:49.604774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e599ff187c144ac382a4de99109c8ae0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:49.624674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1029/2050] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:49 2022] DELETE /identity/v3/users/e599ff187c144ac382a4de99109c8ae0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:49.629813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:49.630309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:49.630426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:49.648513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:49.649714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:49.702484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:49.718058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1022/2051] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:49.728271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:49.729748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:49.809645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8adbd-aa05-4fd7-88fa-688379a55b02 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:49.815010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:49.815010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:49.815010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:49.815010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:49.832293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:49.834328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:49.845384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1030/2052] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:49.899682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:49.901203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:49.966615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2f56f-6a93-49d6-87f1-8c752e4de0e8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:49.970648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:49.971989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:49.972544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:49.972821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:49.974885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.051225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:50.052696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:50.063910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1023/2053] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:50.144189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:50.145696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.161513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6e3-8dde-413e-9d10-42fa0a963843 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:50.169177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:50.170101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:50.170448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:50.170773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] PATH_INFO: `/v3/projects/fdca8f9333b24d1d9c7c49a87df25566` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:50.171987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdca8f9333b24d1d9c7c49a87df25566)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:50.174019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:50.225421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdca8f9333b24d1d9c7c49a87df25566', 'request_id': 'req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.229438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:50.231856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdca8f9333b24d1d9c7c49a87df25566', 'request_id': 'req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.239212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdca8f9333b24d1d9c7c49a87df25566', 'request_id': 'req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.252210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] The token cache is being invalidate because project fdca8f9333b24d1d9c7c49a87df25566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:50.252528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.253167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.254789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1031/2054] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:50 2022] DELETE /identity/v3/projects/fdca8f9333b24d1d9c7c49a87df25566 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:50.258887 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:50.270500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd1630-8b62-4456-8303-25ab78bdf766 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:50.329020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:50.329896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:50.330185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:50.330506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] PATH_INFO: `/v3/users/c20581a5c4024d85930154ef97848e83` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:50.332225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20581a5c4024d85930154ef97848e83)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:50.334133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:50.383291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:50.385046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20581a5c4024d85930154ef97848e83'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.394545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20581a5c4024d85930154ef97848e83'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.395239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20581a5c4024d85930154ef97848e83'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.395968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20581a5c4024d85930154ef97848e83'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.408472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20581a5c4024d85930154ef97848e83'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.423758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1024/2055] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:50 2022] DELETE /identity/v3/users/c20581a5c4024d85930154ef97848e83 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:50.579474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:50.584313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.628251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3376-fe9b-4942-9166-eb6d0161e9fb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:50.711875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:50.712758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:50.713036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:50.713313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] PATH_INFO: `/v3/users/a32990382a2a43e5bda8012422bad826` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:50.714565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32990382a2a43e5bda8012422bad826)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:50.716519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:50.757919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:50.759527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.778320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a189ac0-83a4-4582-9b7e-77711792cfd1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:50.781488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32990382a2a43e5bda8012422bad826'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.784339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:50.785390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:50.785849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:50.786325 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] PATH_INFO: `/v3/projects/94c803b1ca37412889242544817e009e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:50.788144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c803b1ca37412889242544817e009e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:50.791496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:50.793575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32990382a2a43e5bda8012422bad826'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.794621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32990382a2a43e5bda8012422bad826'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.803449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32990382a2a43e5bda8012422bad826'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.804445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3b643a39-0038-4e71-8187-841433281ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32990382a2a43e5bda8012422bad826'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.834386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1032/2056] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:50 2022] DELETE /identity/v3/users/a32990382a2a43e5bda8012422bad826 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:50.839572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:50.839860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:50.840655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:50.855411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c803b1ca37412889242544817e009e', 'request_id': 'req-e153359a-d61c-446a-94f8-182a6c3cae08'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.858517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:50.859721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.862495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c803b1ca37412889242544817e009e', 'request_id': 'req-e153359a-d61c-446a-94f8-182a6c3cae08'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.867701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c803b1ca37412889242544817e009e', 'request_id': 'req-e153359a-d61c-446a-94f8-182a6c3cae08'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.888617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] The token cache is being invalidate because project 94c803b1ca37412889242544817e009e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:50.889045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.889695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:50.891349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1025/2057] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:50 2022] DELETE /identity/v3/projects/94c803b1ca37412889242544817e009e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:50.895942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:50.897284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.938244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1033/2058] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:50.948549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:50.950129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:50.957334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:50.989627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153359a-d61c-446a-94f8-182a6c3cae08 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:50.996579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:50.997454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:50.997832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:50.997997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] PATH_INFO: `/v3/users/1dfbd759a709465b8489514c3f3b4a12` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:50.999545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfbd759a709465b8489514c3f3b4a12)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:51.001621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:51.057845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d55a83-4303-4a27-9781-45608c7157d0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:51.063655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:51.064782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:51.066283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:51.067070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:51.073891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfbd759a709465b8489514c3f3b4a12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.075151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:51.079919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:51.081487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:51.083370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfbd759a709465b8489514c3f3b4a12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.084259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfbd759a709465b8489514c3f3b4a12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.085340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfbd759a709465b8489514c3f3b4a12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.095283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1034/2059] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:51.108092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfbd759a709465b8489514c3f3b4a12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.128527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1026/2060] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:50 2022] DELETE /identity/v3/users/1dfbd759a709465b8489514c3f3b4a12 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:51.474378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:51.488355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd043bd7-860f-4f7b-84b1-8c98552254fd service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:51.580944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:51.583713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:51.584315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:51.585006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] PATH_INFO: `/v3/projects/9235dee4fc6341fd988908c3637c7f4d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:51.586802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9235dee4fc6341fd988908c3637c7f4d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:51.589271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:51.703470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9235dee4fc6341fd988908c3637c7f4d', 'request_id': 'req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.715195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:51.717155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:51.717345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9235dee4fc6341fd988908c3637c7f4d', 'request_id': 'req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.739404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9235dee4fc6341fd988908c3637c7f4d', 'request_id': 'req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.760643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] The token cache is being invalidate because project 9235dee4fc6341fd988908c3637c7f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:51.761162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.762069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a9be7c92-48b3-466d-8dfd-b4142aa8b3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:51.762427 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09b0f-39ae-431f-bf3f-114a2ad8adc5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:51.770888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1035/2061] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:51 2022] DELETE /identity/v3/projects/9235dee4fc6341fd988908c3637c7f4d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:51.772662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351bfb-c068-4f6b-882b-43a5e7a39f7e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:51.773053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351bfb-c068-4f6b-882b-43a5e7a39f7e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:51.773427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351bfb-c068-4f6b-882b-43a5e7a39f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:51.795963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3a351bfb-c068-4f6b-882b-43a5e7a39f7e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:51.797774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a351bfb-c068-4f6b-882b-43a5e7a39f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:51.843319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:51.878699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:51.880933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:51.881483 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:51.881778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] PATH_INFO: `/v3/projects/6510a51cc140427c96d6246e689001ad` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:51.883764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6510a51cc140427c96d6246e689001ad)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:51.885809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:51.900183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1036/2062] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:51.909525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177ff3-d109-413a-8b9e-857757194b99 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:51.909654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177ff3-d109-413a-8b9e-857757194b99 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:51.909880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177ff3-d109-413a-8b9e-857757194b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:51.976452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-27177ff3-d109-413a-8b9e-857757194b99 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:51.978097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-27177ff3-d109-413a-8b9e-857757194b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:52.022531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6510a51cc140427c96d6246e689001ad', 'request_id': 'req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:52.040079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6510a51cc140427c96d6246e689001ad', 'request_id': 'req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:52.047230 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6510a51cc140427c96d6246e689001ad', 'request_id': 'req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:52.092087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] The token cache is being invalidate because project 6510a51cc140427c96d6246e689001ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:52.092385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:52.093316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:52.097294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1027/2063] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:51 2022] DELETE /identity/v3/projects/6510a51cc140427c96d6246e689001ad => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:52.098577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1037/2064] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:52.104142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.106241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11dc70-5ecb-43df-9dae-05becdab5604 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.106801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11dc70-5ecb-43df-9dae-05becdab5604 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.106907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:52.107257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11dc70-5ecb-43df-9dae-05becdab5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.136783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fd11dc70-5ecb-43df-9dae-05becdab5604 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:52.137512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3a610-5180-42c3-bb36-c3c1a571ecf5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.139117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fd11dc70-5ecb-43df-9dae-05becdab5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:52.151626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1038/2065] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:52.163238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.163949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.164642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.168364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.169061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.169346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.169623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.170403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:52.170727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.172360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.199971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1028/2066] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:52.201369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.203232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:52.204570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:52.217540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9ed0-8ac7-40d1-8e30-44bfb4d0fa84 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.217754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1039/2067] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:52.222442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.239243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.240150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.240567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.240950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.241921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.245430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.253050 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055a4ff-9d4b-4a88-b116-cdcb0b9747e8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.269040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.270025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.270565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.270917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.272523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:52.272523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.275705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.286775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1029/2068] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:52.291289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.314552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1040/2069] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:52.336549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.337724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:52.352960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3f88-a24a-4732-bced-e172faf62f3d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.427211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e16f6-f7fe-4c5f-b938-66bfd1ba228d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.433194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.434068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.435026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.435656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.436624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.439608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.447126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.447918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.448223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.448524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.449536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.451550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.466789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1030/2070] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:52.468168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.486667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639295c-1273-42b0-ae03-a6f7097698d4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.487397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1041/2071] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:52.488275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.552448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:52.573757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.574479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.575013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.575295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.580848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.583767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.609354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1031/2072] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:52.615130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.616728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461b5d-3d8c-43e7-aac2-897b1244d06b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.622857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.624686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.625296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.625674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.626615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.627031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edfcd2-ed28-4a43-9731-20f689a9cc65 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.630077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.639060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.640088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.640731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.641190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.642473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.644844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.660122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1042/2073] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:52.661714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1032/2074] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:52.665928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.666303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.677078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d882-3f05-44f7-933f-66b544ad5801 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.678149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340023b9-5dcf-432d-abb3-32d4f9219254 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.681953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.682663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.682944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.683222 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.683798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddaba4-cebe-42fa-93ce-d320b932fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.683953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.684914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddaba4-cebe-42fa-93ce-d320b932fe65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.685266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddaba4-cebe-42fa-93ce-d320b932fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.685627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddaba4-cebe-42fa-93ce-d320b932fe65 admin admin] PATH_INFO: `/v3/projects/872da97efb004ed8a5d5b1f669af09c8/users/98171f2a21f9436bb3d3816be638bb3c/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.685731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.697037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1043/2075] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:52.700932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.705835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddaba4-cebe-42fa-93ce-d320b932fe65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872da97efb004ed8a5d5b1f669af09c8, user_id=98171f2a21f9436bb3d3816be638bb3c, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.708629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddaba4-cebe-42fa-93ce-d320b932fe65 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.714169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaff8f-9769-4283-899c-26038941d187 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.720382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.721039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.721356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.721637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.722464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.723079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1033/2076] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:52 2022] PUT /identity/v3/projects/872da97efb004ed8a5d5b1f669af09c8/users/98171f2a21f9436bb3d3816be638bb3c/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:52.727614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.735381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.735865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.736150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.741899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1044/2077] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:10:52.746151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.756827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b3539-419b-439d-b47f-59c44eb08575 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.767689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] MFA Rules not processed for user `98171f2a21f9436bb3d3816be638bb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:52.769871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:52.821968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb592-d9e0-43fb-b982-2be421dd9a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.823074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb592-d9e0-43fb-b982-2be421dd9a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.823358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb592-d9e0-43fb-b982-2be421dd9a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.823639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb592-d9e0-43fb-b982-2be421dd9a57 admin admin] PATH_INFO: `/v3/projects/bf3422b10fcb4760abac89590e4edcd6/users/25202e7e67dc4b30ba607d26f7eddc05/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.841103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb592-d9e0-43fb-b982-2be421dd9a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3422b10fcb4760abac89590e4edcd6, user_id=25202e7e67dc4b30ba607d26f7eddc05, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.844016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb592-d9e0-43fb-b982-2be421dd9a57 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.851617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:52.856540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1034/2078] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:52.861518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1045/2079] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:52 2022] PUT /identity/v3/projects/bf3422b10fcb4760abac89590e4edcd6/users/25202e7e67dc4b30ba607d26f7eddc05/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:52.862885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:52.870680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.870974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.871318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.877226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccef5f-6f14-4a7d-acec-511a578d0d97 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:52.899727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] MFA Rules not processed for user `25202e7e67dc4b30ba607d26f7eddc05`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:52.900971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:52.960148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:52.960834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:52.961128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:52.961396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:52.962093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:52.964039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:52.998867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1035/2080] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:53.003631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.003839 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1046/2081] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:10:53.018026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.019751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:53.050453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:53.104725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e551694-b8d4-41df-9b27-dfbe7d78dcf1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.149411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5ceed-6ea7-4054-8cbb-4e1bc2c53ded admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.172640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.174798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.174947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.175164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.175437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.176869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.186421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.186421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.186421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.186421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.219680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1036/2082] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:53 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:53.227920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.243699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe8f37-f526-435a-a323-206bb2363855 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.250760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.251126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.251603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.251890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.253051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.255425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.272120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1037/2083] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:53.274088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.275809 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.277445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.286745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1047/2084] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:53.290462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccd167-538b-4c34-ab65-04c3bc14c823 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.296072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.297031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.297383 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.297939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] PATH_INFO: `/v3/projects/2522342e319e4ab9873e309b36001752/users/28e12d7377e440468d90595b0c6ae4d7/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.316179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2522342e319e4ab9873e309b36001752, user_id=28e12d7377e440468d90595b0c6ae4d7, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.318976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.338416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1038/2085] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:53 2022] PUT /identity/v3/projects/2522342e319e4ab9873e309b36001752/users/28e12d7377e440468d90595b0c6ae4d7/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:53.344997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.366121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1387e5-3bbf-4cce-8495-33e27fbe4355 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.462021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583189d-f1f4-4bc1-92c0-cf84dca16499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.462737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583189d-f1f4-4bc1-92c0-cf84dca16499 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.463017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583189d-f1f4-4bc1-92c0-cf84dca16499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.463295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583189d-f1f4-4bc1-92c0-cf84dca16499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.464041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583189d-f1f4-4bc1-92c0-cf84dca16499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.465784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583189d-f1f4-4bc1-92c0-cf84dca16499 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.493061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1048/2086] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:53.495275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.510060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d672146-dd19-41a6-99c8-637492ae6ab7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.519843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.521659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.522333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.522843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] PATH_INFO: `/v3/projects/2522342e319e4ab9873e309b36001752/users/28e12d7377e440468d90595b0c6ae4d7/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.526984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2522342e319e4ab9873e309b36001752, user_id=28e12d7377e440468d90595b0c6ae4d7, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.530283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.554669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1039/2087] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:53 2022] PUT /identity/v3/projects/2522342e319e4ab9873e309b36001752/users/28e12d7377e440468d90595b0c6ae4d7/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:53.565548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.566035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.566533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.606029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] MFA Rules not processed for user `28e12d7377e440468d90595b0c6ae4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:53.607591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:53.637425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:53.731991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1049/2088] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:53.757774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.759477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:53.795515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:53.825019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbfdff-4b61-4754-84c2-b5e84f715cb6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.829622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.831116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.831413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.831979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:53.843832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:53.845737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:53.856743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1040/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:53.947933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:53.958041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d684e0-4f58-44b0-a760-f6fb317f794e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:53.961574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:53.962211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:53.962542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:53.962805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.028733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:54.030202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:54.041554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1050/2090] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:54.284140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:54.285570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:54.373231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:54.381382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e270-7111-4409-a807-99129e50eafb service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:54.385256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67331570-c9e8-4dc2-9dc7-d2069053709c service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:54.386905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:54.388236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:54.388875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:54.389165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] PATH_INFO: `/v3/users/923f1e54248c47ddb764c9d6907eb1bf` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.390055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:54.390761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923f1e54248c47ddb764c9d6907eb1bf)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:54.391160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:54.391445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:54.391732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] PATH_INFO: `/v3/users/98171f2a21f9436bb3d3816be638bb3c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.394945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:54.396087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98171f2a21f9436bb3d3816be638bb3c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:54.396087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:54.451665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923f1e54248c47ddb764c9d6907eb1bf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.463354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923f1e54248c47ddb764c9d6907eb1bf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.465328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98171f2a21f9436bb3d3816be638bb3c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.466596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923f1e54248c47ddb764c9d6907eb1bf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.467458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923f1e54248c47ddb764c9d6907eb1bf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.474877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98171f2a21f9436bb3d3816be638bb3c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.475836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98171f2a21f9436bb3d3816be638bb3c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.486076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98171f2a21f9436bb3d3816be638bb3c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.486769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-128156f6-bd2d-4d8b-a976-554a009e2156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98171f2a21f9436bb3d3816be638bb3c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.492455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e9fd288c-b7ae-466d-896d-4789fe1ca349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923f1e54248c47ddb764c9d6907eb1bf'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:54.509770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1051/2091] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:54 2022] DELETE /identity/v3/users/98171f2a21f9436bb3d3816be638bb3c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:54.512802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1041/2092] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:54 2022] DELETE /identity/v3/users/923f1e54248c47ddb764c9d6907eb1bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:54.514456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:54.514636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:54.514743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:54.515013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.515335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:54.515776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.536189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:54.536336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:54.537396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:54.537489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:54.556921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:54.599908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:54.616223 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1052/2093] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:54.625340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1042/2094] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:54.631822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:54.633222 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:54.637931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:54.639795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:54.710566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a995078-ed68-4923-9643-39c19566d0b2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:54.716024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:54.716941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:54.717264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:54.717624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.732380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:54.733148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e199f-a932-421d-b8cd-7178bb21cc02 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:54.734724 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:54.748950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1053/2095] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:54.760063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:54.760807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:54.761100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:54.761381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:54.777519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:54.779198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:54.808657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1043/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:10:55.159533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:55.161818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.181153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:55.182953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.185333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4c678-8046-4b2e-83a0-5eb7e88ae681 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:55.206505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e017c38-6c82-4e96-8fbf-8c73a6dc53dd service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:55.216709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:55.217833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.218327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.222418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] PATH_INFO: `/v3/projects/872da97efb004ed8a5d5b1f669af09c8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.224935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=872da97efb004ed8a5d5b1f669af09c8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:55.227225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:55.227670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:55.228553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.228837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.229233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] PATH_INFO: `/v3/users/9fd2f766394046e8bf646396a14846bf` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.231179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd2f766394046e8bf646396a14846bf)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:55.233109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:55.301739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd2f766394046e8bf646396a14846bf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.312163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd2f766394046e8bf646396a14846bf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.313034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd2f766394046e8bf646396a14846bf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.321237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872da97efb004ed8a5d5b1f669af09c8', 'request_id': 'req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.326578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd2f766394046e8bf646396a14846bf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.327231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd2f766394046e8bf646396a14846bf'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.328101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872da97efb004ed8a5d5b1f669af09c8', 'request_id': 'req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.339351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872da97efb004ed8a5d5b1f669af09c8', 'request_id': 'req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.352588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1054/2097] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:55 2022] DELETE /identity/v3/users/9fd2f766394046e8bf646396a14846bf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:55.353841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:55.360141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.361493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] The token cache is being invalidate because project 872da97efb004ed8a5d5b1f669af09c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:55.363365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.365686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c7f9b39-af2f-47ab-b754-2819b8c96f4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.370626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1044/2098] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:55 2022] DELETE /identity/v3/projects/872da97efb004ed8a5d5b1f669af09c8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:55.372445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.373062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.373728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.395362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:55.396840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.411874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:55.444617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75abc8-a0a9-4573-8cc5-a97055da15c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:55.450185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:55.451088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.451408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.451689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] PATH_INFO: `/v3/projects/cbb2b50ced624cdea47c3424ecff5e7b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.452869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb2b50ced624cdea47c3424ecff5e7b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:55.454827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:55.461905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1045/2099] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:55.462976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:55.464271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.477661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158c9d-36b3-42f0-a081-80e09222e160 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:55.482660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:55.483566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.483847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.484126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] PATH_INFO: `/v3/users/28e12d7377e440468d90595b0c6ae4d7` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.485386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e12d7377e440468d90595b0c6ae4d7)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:55.487503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:55.500801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:55.512115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb2b50ced624cdea47c3424ecff5e7b', 'request_id': 'req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.519163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb2b50ced624cdea47c3424ecff5e7b', 'request_id': 'req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.526181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb2b50ced624cdea47c3424ecff5e7b', 'request_id': 'req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.540702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] The token cache is being invalidate because project cbb2b50ced624cdea47c3424ecff5e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:55.541981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.542981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.544290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e12d7377e440468d90595b0c6ae4d7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.545114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1055/2100] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:55 2022] DELETE /identity/v3/projects/cbb2b50ced624cdea47c3424ecff5e7b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:55.545995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:55.548214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.554829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e12d7377e440468d90595b0c6ae4d7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.555922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e12d7377e440468d90595b0c6ae4d7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.556787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e12d7377e440468d90595b0c6ae4d7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.570710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e12d7377e440468d90595b0c6ae4d7'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.585267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1046/2101] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:55 2022] DELETE /identity/v3/users/28e12d7377e440468d90595b0c6ae4d7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:55.586256 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:55.587573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.633466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c953d01-ccb4-4e93-9e73-9e727b9b1a16 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:55.695805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:55.696596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.697924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.698312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.700358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:55.702929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c814f-c085-43ed-b4c2-8ccca10b9f86 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:55.711398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:55.713394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:55.713712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:55.713974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] PATH_INFO: `/v3/users/10f154891abf4894a503e5247bc9ec19` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:55.715090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:55.715671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f154891abf4894a503e5247bc9ec19)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:55.718686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:55.725080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:55.732191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1056/2102] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:55.789948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f154891abf4894a503e5247bc9ec19'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.797873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f154891abf4894a503e5247bc9ec19'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.798689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f154891abf4894a503e5247bc9ec19'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.799356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f154891abf4894a503e5247bc9ec19'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.814041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f154891abf4894a503e5247bc9ec19'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:55.836986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1047/2103] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:55 2022] DELETE /identity/v3/users/10f154891abf4894a503e5247bc9ec19 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:56.159655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:56.162904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.177533 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b74a0b-b693-47a6-a1f3-49d2f2a3c070 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:56.195364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:56.196870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.214240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:56.220452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:56.309447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:56.310587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.311090 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.311721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] PATH_INFO: `/v3/projects/2522342e319e4ab9873e309b36001752` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.313569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2522342e319e4ab9873e309b36001752)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:56.316506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:56.348775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00943b2-c53d-44ad-8eeb-64ee878a10a4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:56.369255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:56.370350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.370715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.370911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] PATH_INFO: `/v3/users/25202e7e67dc4b30ba607d26f7eddc05` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.372643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25202e7e67dc4b30ba607d26f7eddc05)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:56.375330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:56.464285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2522342e319e4ab9873e309b36001752', 'request_id': 'req-dadb354a-348d-4282-a265-fdef1d3b200f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.472253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2522342e319e4ab9873e309b36001752', 'request_id': 'req-dadb354a-348d-4282-a265-fdef1d3b200f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.484004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2522342e319e4ab9873e309b36001752', 'request_id': 'req-dadb354a-348d-4282-a265-fdef1d3b200f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.488782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25202e7e67dc4b30ba607d26f7eddc05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.500012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25202e7e67dc4b30ba607d26f7eddc05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.501100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25202e7e67dc4b30ba607d26f7eddc05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.502111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25202e7e67dc4b30ba607d26f7eddc05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.504322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] The token cache is being invalidate because project 2522342e319e4ab9873e309b36001752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:56.504614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.505910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.507964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1057/2104] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:56 2022] DELETE /identity/v3/projects/2522342e319e4ab9873e309b36001752 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:56.508889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:56.511354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.536982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25202e7e67dc4b30ba607d26f7eddc05'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.555113 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1048/2105] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:56 2022] DELETE /identity/v3/users/25202e7e67dc4b30ba607d26f7eddc05 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:10:56.556429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:56.559726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.606504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb354a-348d-4282-a265-fdef1d3b200f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:56.673239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39127043-9a18-4c14-a717-ccd4bba42369 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:56.680164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:56.681433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.682182 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.683423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] PATH_INFO: `/v3/users/6a79068b6a574256b35ca19e0d6a2041` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.684053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a79068b6a574256b35ca19e0d6a2041)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:56.686030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:56.734264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:56.739123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:56.740131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.740615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.741005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] PATH_INFO: `/v3/projects/5e71ad234fa841619393da06da7cec02` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.746067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e71ad234fa841619393da06da7cec02)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:56.748925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:56.757208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:56.771277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a79068b6a574256b35ca19e0d6a2041'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.779833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a79068b6a574256b35ca19e0d6a2041'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.780856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a79068b6a574256b35ca19e0d6a2041'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.781465 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a79068b6a574256b35ca19e0d6a2041'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.795908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8d03856c-ef00-4a96-95f1-7cd3928f8c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a79068b6a574256b35ca19e0d6a2041'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.811781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1049/2106] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:56 2022] DELETE /identity/v3/users/6a79068b6a574256b35ca19e0d6a2041 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:56.815775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.815775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.815775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.829795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e71ad234fa841619393da06da7cec02', 'request_id': 'req-db4bc724-f679-4cf7-83f0-46f18c96babd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.836265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:56.837296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e71ad234fa841619393da06da7cec02', 'request_id': 'req-db4bc724-f679-4cf7-83f0-46f18c96babd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.837981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.844424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e71ad234fa841619393da06da7cec02', 'request_id': 'req-db4bc724-f679-4cf7-83f0-46f18c96babd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.863145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] The token cache is being invalidate because project 5e71ad234fa841619393da06da7cec02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:56.863864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.864422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-db4bc724-f679-4cf7-83f0-46f18c96babd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:56.866702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1058/2107] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:56 2022] DELETE /identity/v3/projects/5e71ad234fa841619393da06da7cec02 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:56.868706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049a8c-72ba-4ff4-80e6-b131dd2e6951 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.869148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049a8c-72ba-4ff4-80e6-b131dd2e6951 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.870328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049a8c-72ba-4ff4-80e6-b131dd2e6951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.891935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-53049a8c-72ba-4ff4-80e6-b131dd2e6951 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:56.894754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53049a8c-72ba-4ff4-80e6-b131dd2e6951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.913429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1050/2108] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:56.919503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:56.921076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:56.934836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7741681-1aa6-413c-adae-46618652ac9b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:56.942412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:56.943067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.943656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.943777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] PATH_INFO: `/v3/projects/e74127e316344112a47045f230817ebe` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.945747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74127e316344112a47045f230817ebe)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:56.947038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:56.974829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1059/2109] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:56.978145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e1eb-8fdb-40a1-ab17-9400d25bb472 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:56.978145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e1eb-8fdb-40a1-ab17-9400d25bb472 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:56.978145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59e1eb-8fdb-40a1-ab17-9400d25bb472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:56.996688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0e59e1eb-8fdb-40a1-ab17-9400d25bb472 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:56.997972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0e59e1eb-8fdb-40a1-ab17-9400d25bb472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.006405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74127e316344112a47045f230817ebe', 'request_id': 'req-fc48f773-784c-441c-9e4e-243b0e84610d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.012454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74127e316344112a47045f230817ebe', 'request_id': 'req-fc48f773-784c-441c-9e4e-243b0e84610d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.019813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74127e316344112a47045f230817ebe', 'request_id': 'req-fc48f773-784c-441c-9e4e-243b0e84610d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.041326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] The token cache is being invalidate because project e74127e316344112a47045f230817ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:57.041625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.042335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.044475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1051/2110] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:56 2022] DELETE /identity/v3/projects/e74127e316344112a47045f230817ebe => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:57.045061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.047586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.081534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1060/2111] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:57.083337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.083805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.084361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.086828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:57.110154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:57.111503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.121467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1061/2112] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:57.121670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48f773-784c-441c-9e4e-243b0e84610d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.126061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.127044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.128604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.129666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.129950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.130259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] PATH_INFO: `/v3/users/b153b51f656a47e897ff635bf33fe76d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.131410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b153b51f656a47e897ff635bf33fe76d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.133447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.159560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:57.187269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b153b51f656a47e897ff635bf33fe76d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.195194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b153b51f656a47e897ff635bf33fe76d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.195886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b153b51f656a47e897ff635bf33fe76d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.196504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b153b51f656a47e897ff635bf33fe76d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.200683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9292b5e-d958-4a9b-84d3-cda1e103e646 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.204868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.205557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.205842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.206118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.208125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.210053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-19bda29f-41b2-4ffd-a0fd-aa3ae5f01603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b153b51f656a47e897ff635bf33fe76d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:57.221698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.223273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.227266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1052/2113] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:57 2022] DELETE /identity/v3/users/b153b51f656a47e897ff635bf33fe76d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:57.230349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.230349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.230349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.234134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1062/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:57.234870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.236144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.249151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdbfe-1768-49dd-a8b0-ad5a62cd2fa4 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.250523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:57.253067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.316561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.317219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.317502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.317779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.320829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.365990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1053/2115] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:57.366917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.381986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.400579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee6a48-d4d6-43d0-9966-7c152df6ac4c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.413898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.414740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.414869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.415149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.415899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:57.416208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.418033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e71e8a-27db-4596-8e16-3efb42c809dc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.440093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1054/2116] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:57.441834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.442874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.443703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.470106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:57.475924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.477910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.479394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.488637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1055/2117] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:57.492195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.505147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e563db0-8d65-468d-b7bf-6e8e234d4461 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.508271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1063/2118] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:57.509574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.511984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.512754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.513422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.514031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.515290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.517621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.535610 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca09f1-cbf5-47e4-a347-756c7e77f52b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.550858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.551802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.553778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.554448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.555433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:57.556581 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.559087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.582796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1064/2119] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:57.583852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.587696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1056/2120] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:57.589778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.603045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf6541-2250-4eb1-bd2c-ec1a97e20fe6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.614817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:57.682561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.684144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.684761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.684761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.685555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.687704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.698595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:57.716597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114f55d-b128-4788-a5e6-3c697b5edcbb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.735591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1065/2121] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:57.740261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.842581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.844904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.845453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.847265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.853683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.856153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.888074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820656c-c411-4c6a-9123-34513144dc93 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.902292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1057/2122] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:57.902292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.903364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.904514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.905850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:57.907477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.907774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.908532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.915443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.942026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5db362-32fa-4531-93d5-05d6fa62ae0b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:57.954272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:57.957646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:57.957951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:57.958252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] PATH_INFO: `/v3/projects/61304cedd48b458ca9588c0120e9b7c9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:57.959706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] RBAC: Authorizing `identity:delete_project(project_id=61304cedd48b458ca9588c0120e9b7c9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:57.970623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1066/2123] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:57 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:10:57.970623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:57.970848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:57.999520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60426b-f739-4975-88f6-1adf9497a742 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.019226 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.020094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.020388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.020673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.024704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.026982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.050959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1067/2124] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:58.053880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.066853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ca4ec-b45c-40c0-8b14-f69acfd060ec admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.080316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61304cedd48b458ca9588c0120e9b7c9', 'request_id': 'req-0635253d-e3a1-444a-896d-19f3ac4d791d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.090264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61304cedd48b458ca9588c0120e9b7c9', 'request_id': 'req-0635253d-e3a1-444a-896d-19f3ac4d791d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.097804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61304cedd48b458ca9588c0120e9b7c9', 'request_id': 'req-0635253d-e3a1-444a-896d-19f3ac4d791d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.124469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] The token cache is being invalidate because project 61304cedd48b458ca9588c0120e9b7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:58.125435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.126697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.132851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1058/2125] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:57 2022] DELETE /identity/v3/projects/61304cedd48b458ca9588c0120e9b7c9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:58.132851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.133673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.174450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:58.185878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.189221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.190619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.191490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.193754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.196605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.238203 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1068/2126] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:58.244250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.247678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.257443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635253d-e3a1-444a-896d-19f3ac4d791d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.265118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.269404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.269943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.270403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] PATH_INFO: `/v3/projects/bf3422b10fcb4760abac89590e4edcd6` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.272364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3422b10fcb4760abac89590e4edcd6)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.277658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3513-926d-435f-abfb-b640b8b88b89 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.283198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.289916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0449ffb-10c9-4aee-bfa3-42480bf0a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.290689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0449ffb-10c9-4aee-bfa3-42480bf0a5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.290980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0449ffb-10c9-4aee-bfa3-42480bf0a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.291189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0449ffb-10c9-4aee-bfa3-42480bf0a5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.292093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0449ffb-10c9-4aee-bfa3-42480bf0a5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.293650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0449ffb-10c9-4aee-bfa3-42480bf0a5ba admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.321452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1069/2127] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:58.322825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.323109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.323388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.345313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:58.346641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.354855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3422b10fcb4760abac89590e4edcd6', 'request_id': 'req-66fd5251-21aa-4f5e-ad59-c841d039ae31'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.361583 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3422b10fcb4760abac89590e4edcd6', 'request_id': 'req-66fd5251-21aa-4f5e-ad59-c841d039ae31'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.368639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3422b10fcb4760abac89590e4edcd6', 'request_id': 'req-66fd5251-21aa-4f5e-ad59-c841d039ae31'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.383672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] The token cache is being invalidate because project bf3422b10fcb4760abac89590e4edcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:58.383958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.384979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.386393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1059/2128] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:58 2022] DELETE /identity/v3/projects/bf3422b10fcb4760abac89590e4edcd6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:58.387130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.390886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.406106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:58.424797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1070/2129] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:58.425998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.431792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.446291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f57cf-51ce-494b-8116-3f20a858b183 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.451427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.452141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.452432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.452716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.453455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.455105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.465537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1071/2130] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:58.466438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.467586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd5251-21aa-4f5e-ad59-c841d039ae31 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.469983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.472692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.473591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.473844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.474118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] PATH_INFO: `/v3/projects/1c8bc078a59948dbae4e330ca70d834c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.475469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8bc078a59948dbae4e330ca70d834c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.477379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.483953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8076e2-26f7-484c-a7f4-75f94a55ac5f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.496765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747897f6-78ac-44c3-aeef-d8a58e8fb029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.497685 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747897f6-78ac-44c3-aeef-d8a58e8fb029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.497972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747897f6-78ac-44c3-aeef-d8a58e8fb029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.498446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747897f6-78ac-44c3-aeef-d8a58e8fb029 admin admin] PATH_INFO: `/v3/projects/4970b9faf2514a2c95291a27956815d9/users/aaa319ce8f774558b4512a8ff9e6f2b1/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.518546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747897f6-78ac-44c3-aeef-d8a58e8fb029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4970b9faf2514a2c95291a27956815d9, user_id=aaa319ce8f774558b4512a8ff9e6f2b1, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.522638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747897f6-78ac-44c3-aeef-d8a58e8fb029 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.548530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1072/2131] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:58 2022] PUT /identity/v3/projects/4970b9faf2514a2c95291a27956815d9/users/aaa319ce8f774558b4512a8ff9e6f2b1/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:58.551121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.551682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.551935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.577807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8bc078a59948dbae4e330ca70d834c', 'request_id': 'req-892a44e3-325b-464b-88cb-825aa5aea72a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.590428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:58.591925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8bc078a59948dbae4e330ca70d834c', 'request_id': 'req-892a44e3-325b-464b-88cb-825aa5aea72a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.593929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:58.594385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.605792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8bc078a59948dbae4e330ca70d834c', 'request_id': 'req-892a44e3-325b-464b-88cb-825aa5aea72a'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.623262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] The token cache is being invalidate because project 1c8bc078a59948dbae4e330ca70d834c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:10:58.623691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.624653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-892a44e3-325b-464b-88cb-825aa5aea72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.629909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1060/2132] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:58 2022] DELETE /identity/v3/projects/1c8bc078a59948dbae4e330ca70d834c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:58.629909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca54ed-ffc7-4ba4-be42-68e0afb0d952 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.629909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca54ed-ffc7-4ba4-be42-68e0afb0d952 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.629909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca54ed-ffc7-4ba4-be42-68e0afb0d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.652991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-68ca54ed-ffc7-4ba4-be42-68e0afb0d952 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:58.654520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-68ca54ed-ffc7-4ba4-be42-68e0afb0d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.684624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1073/2133] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:58.685713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.686654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1061/2134] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:58.688926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf95b-44a4-4cbe-aa30-e18e67886a03 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.691170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.691356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf95b-44a4-4cbe-aa30-e18e67886a03 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.691602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbf95b-44a4-4cbe-aa30-e18e67886a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.704490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c6531-25d6-40f5-a00e-0a6d89ee361a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.709885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.710926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.711277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.711627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] PATH_INFO: `/v3/projects/5ecbe2ca5e384fcab52527173ad6555d/users/8e49d122b4a945a8b4cb53dd0edc0f1d/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.729487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecbe2ca5e384fcab52527173ad6555d, user_id=8e49d122b4a945a8b4cb53dd0edc0f1d, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.732327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.733991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-67fbf95b-44a4-4cbe-aa30-e18e67886a03 None None] MFA Rules not processed for user `aaa319ce8f774558b4512a8ff9e6f2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:58.735537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-67fbf95b-44a4-4cbe-aa30-e18e67886a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.750422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1074/2135] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:10:58 2022] PUT /identity/v3/projects/5ecbe2ca5e384fcab52527173ad6555d/users/8e49d122b4a945a8b4cb53dd0edc0f1d/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:58.751452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.753761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.837466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1062/2136] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:58.838944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.839310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.839663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.850442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ed05c-2aab-419e-8ed4-3279d5289688 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.860140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.862273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.863084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.863465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] PATH_INFO: `/v3/users/67420cc2609043de8dddef6c04b465c1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.864457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:58.866260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=67420cc2609043de8dddef6c04b465c1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.867939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.868463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:58.882444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1063/2137] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:58.883635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.895224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48c07-2727-4ef7-95e9-1c2178ececeb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:58.901837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:58.903132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.903650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.904157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.904984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:58.905375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:58.907148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53199e4e-c55a-4c0c-8684-9052de11c8b8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:58.925393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1064/2138] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:58.925748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:58.927053 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:58.927550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:58.938266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67420cc2609043de8dddef6c04b465c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.942045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:58.950142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67420cc2609043de8dddef6c04b465c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.951512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67420cc2609043de8dddef6c04b465c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.962619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67420cc2609043de8dddef6c04b465c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.963266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67420cc2609043de8dddef6c04b465c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:10:58.988922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1075/2139] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:10:58 2022] DELETE /identity/v3/users/67420cc2609043de8dddef6c04b465c1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:10:58.993360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:58.995211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:59.011051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] MFA Rules not processed for user `8e49d122b4a945a8b4cb53dd0edc0f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:10:59.013269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:59.122455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1065/2140] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:10:59.123600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d192fe-9aa1-40a3-90e1-7725345238ea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.124552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.126816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:59.136449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.137315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.137688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.137963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.138739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.140738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.146864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122a75-6cec-4792-bdab-8741eaa27721 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.152548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.153283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.153572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.154988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.155562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:10:59.155876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.157829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.172868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1066/2141] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:10:59.178193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.181035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1076/2142] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:58 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.181124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:59.181229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.184657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:59.201003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32bfcd-1028-44b9-aed0-798a2285e376 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.231229 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:59.277899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3bad8-a449-46e0-95e5-7e4527b08780 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.280663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.281587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.281978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.282955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.283929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.285920 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.286625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.286814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.287108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.287495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.288355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.291289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.340795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1077/2143] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.340994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1067/2144] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.340994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.341593 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.413654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:59.498816 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc51b4-fe35-498c-bcfe-d1251433c982 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.500240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3a948-4241-40ff-a09d-7e3c45bcca4e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.507154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.507983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.508331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.508684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.509492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.512689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.514445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.514652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.514944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.515671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.519487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.526972 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.567518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1078/2145] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.572218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.586196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1068/2146] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.593344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.613040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ec2e7-5b22-4099-aa9e-2af1cb7ca373 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.685541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ee91-42b7-4722-8307-d02c6b272428 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.701674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.703998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.704612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.706569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.707446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.709642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.715510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.716640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.717101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.717552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.718588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.720767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.765634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1079/2147] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.767120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1069/2148] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.768866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.772121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.790582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc233d-2b28-4171-8cb7-652975dccbb7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.796371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43297e9-071f-48cc-a977-3ad9c98b294c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.798913 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.800056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.800630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.801258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.802350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.804662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.835006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.836719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.837989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.838944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.841970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.844745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.853626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1080/2149] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:10:59 2022] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:10:59.854634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.876560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f1a05-a351-4178-9915-7fe74a404819 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.884555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1070/2150] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:59.885625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.907802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.909026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.909622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.910082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.911178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.913381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1156f-f084-4572-b185-5bd0716fd8fb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.913650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.933476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1081/2151] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:59.934546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.935457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.939597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:59.940623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.941093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.942043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.943730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:59.961384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e72d1-f3b2-4f8d-adcf-a72658fa1a95 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:59.971613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:59.975375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:59.975973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:59.976625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] PATH_INFO: `/v3/projects/369f3847003d4c1b97c48b90596aeb87` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:59.979119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.981260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=369f3847003d4c1b97c48b90596aeb87)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:59.984030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:59.997855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1071/2152] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:10:59.998922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.013618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba00b-eb5b-42b5-b538-18521c696b71 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.028170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.028934 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.029318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.029685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.030760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.037990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.041026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:00.055924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1072/2153] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:00.056928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.066276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369f3847003d4c1b97c48b90596aeb87', 'request_id': 'req-2e017c2c-5e24-467f-8dfc-574e4b858910'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:00.071091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b6eec-8788-48b6-ab96-f8b4a6556083 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.076781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369f3847003d4c1b97c48b90596aeb87', 'request_id': 'req-2e017c2c-5e24-467f-8dfc-574e4b858910'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:00.085336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369f3847003d4c1b97c48b90596aeb87', 'request_id': 'req-2e017c2c-5e24-467f-8dfc-574e4b858910'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:00.088947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:INSERT=8,keystone:DELETE=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:00.105592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] The token cache is being invalidate because project 369f3847003d4c1b97c48b90596aeb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:00.106270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:00.107216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:00.109418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1082/2154] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:10:59 2022] DELETE /identity/v3/projects/369f3847003d4c1b97c48b90596aeb87 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.110438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.112725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.152967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.156295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.156295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.156295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] PATH_INFO: `/v3/projects/969c0741163747f59b52de18595c033b/users/caa41ffa48bc4feda62ccee2685547ed/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.170754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969c0741163747f59b52de18595c033b, user_id=caa41ffa48bc4feda62ccee2685547ed, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.174571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.189551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1073/2155] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:00 2022] PUT /identity/v3/projects/969c0741163747f59b52de18595c033b/users/caa41ffa48bc4feda62ccee2685547ed/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.193954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.196252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.196580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017c2c-5e24-467f-8dfc-574e4b858910 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.285245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.286382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.286743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.287076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] PATH_INFO: `/v3/projects/315ee2c27801477fb51d688e317c8d68/users/403d1846226b494e8ac368f00edb6b76/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.306487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315ee2c27801477fb51d688e317c8d68, user_id=403d1846226b494e8ac368f00edb6b76, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.309534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.328478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1083/2156] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:00 2022] PUT /identity/v3/projects/315ee2c27801477fb51d688e317c8d68/users/403d1846226b494e8ac368f00edb6b76/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.333532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.335440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.350424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41406df-3c18-4ec4-96a6-9ab95c51c5d4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.429753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71dd174-1781-4941-878d-a73659308a27 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.435550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99166728-3de5-4367-aa86-aec10bef7d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.436502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99166728-3de5-4367-aa86-aec10bef7d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.436870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99166728-3de5-4367-aa86-aec10bef7d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.437220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99166728-3de5-4367-aa86-aec10bef7d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.438093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99166728-3de5-4367-aa86-aec10bef7d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.439841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99166728-3de5-4367-aa86-aec10bef7d43 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.454404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1084/2157] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:00.456087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.462822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.463534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.464956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.465652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.465940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.466237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.467022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.468606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.496381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1074/2158] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:00.496381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.498953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.499209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:00.500807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.520717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1085/2159] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:00.520717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.520975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf29b8a-4a1b-48b4-88fb-62392d804e26 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.526294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec340b64-f1f9-4b36-b785-cad0fc8a61b6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.530623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.531416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.531719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.533181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.534179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.537246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.539374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.540315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.540672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.540997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.543566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.546452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.554177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1075/2160] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:00.555342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.569281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56981ae-15bb-4585-83a1-291a3849c48c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.570394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1086/2161] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:00.571605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.576837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:00.578249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a587cd-b11b-4da4-b196-ae9f4c1acfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.579430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a587cd-b11b-4da4-b196-ae9f4c1acfdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.579723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a587cd-b11b-4da4-b196-ae9f4c1acfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.580049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a587cd-b11b-4da4-b196-ae9f4c1acfdb admin admin] PATH_INFO: `/v3/projects/77e6d2ce77e0434c98a2104e76cf0202/users/b96f9992385d4661ba4de3a9a8ac3c74/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.584425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a7716-c83f-4acc-abc4-8afbd56d35ed admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.594513 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.595526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.596602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.596980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] PATH_INFO: `/v3/projects/23a301a6181b4352872e9b2ef4ff42c8/users/f01d45401f08406b817d2766a0a5900c/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.619577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:00.627742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a301a6181b4352872e9b2ef4ff42c8, user_id=f01d45401f08406b817d2766a0a5900c, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.631633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.632667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a587cd-b11b-4da4-b196-ae9f4c1acfdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e6d2ce77e0434c98a2104e76cf0202, user_id=b96f9992385d4661ba4de3a9a8ac3c74, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.636406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a587cd-b11b-4da4-b196-ae9f4c1acfdb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.654928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1076/2162] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:00 2022] PUT /identity/v3/projects/77e6d2ce77e0434c98a2104e76cf0202/users/b96f9992385d4661ba4de3a9a8ac3c74/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.664107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.664107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.664107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.665325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1087/2163] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:00 2022] PUT /identity/v3/projects/23a301a6181b4352872e9b2ef4ff42c8/users/f01d45401f08406b817d2766a0a5900c/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.670795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.678714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:00.680614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.750815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1077/2164] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:00.751513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:00.767491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b72e3-4732-4bdd-9c88-7abcd4a389b9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.786264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4a7b5-6ee1-4a7d-bb08-9af07930793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.787780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4a7b5-6ee1-4a7d-bb08-9af07930793c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.788342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4a7b5-6ee1-4a7d-bb08-9af07930793c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.788512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4a7b5-6ee1-4a7d-bb08-9af07930793c admin admin] PATH_INFO: `/v3/projects/315ee2c27801477fb51d688e317c8d68/users/403d1846226b494e8ac368f00edb6b76/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.790569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4a7b5-6ee1-4a7d-bb08-9af07930793c admin admin] RBAC: Authorizing `identity:create_grant(project_id=315ee2c27801477fb51d688e317c8d68, user_id=403d1846226b494e8ac368f00edb6b76, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.793464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4a7b5-6ee1-4a7d-bb08-9af07930793c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.808470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f018ca1-a91d-42d7-b8a9-bdd987b86b54 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:00.827102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1078/2165] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:00 2022] PUT /identity/v3/projects/315ee2c27801477fb51d688e317c8d68/users/403d1846226b494e8ac368f00edb6b76/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.827102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.828397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.828397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.902020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] MFA Rules not processed for user `b96f9992385d4661ba4de3a9a8ac3c74`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:00.905124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:00.911085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee12edb-fba8-4ef0-b3d2-8133ffc3d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:00.912195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12edb-fba8-4ef0-b3d2-8133ffc3d6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.912527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12edb-fba8-4ef0-b3d2-8133ffc3d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.912812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee12edb-fba8-4ef0-b3d2-8133ffc3d6e6 admin admin] PATH_INFO: `/v3/projects/969c0741163747f59b52de18595c033b/users/caa41ffa48bc4feda62ccee2685547ed/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.915180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12edb-fba8-4ef0-b3d2-8133ffc3d6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969c0741163747f59b52de18595c033b, user_id=caa41ffa48bc4feda62ccee2685547ed, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:00.918193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee12edb-fba8-4ef0-b3d2-8133ffc3d6e6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:00.944175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1088/2166] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:00 2022] PUT /identity/v3/projects/969c0741163747f59b52de18595c033b/users/caa41ffa48bc4feda62ccee2685547ed/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:00.946365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805756-ebc2-443e-833d-b0493a551780 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:00.946849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805756-ebc2-443e-833d-b0493a551780 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:00.947611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805756-ebc2-443e-833d-b0493a551780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:00.977127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e1805756-ebc2-443e-833d-b0493a551780 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:00.978999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e1805756-ebc2-443e-833d-b0493a551780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.062610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1079/2167] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:01.065665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.096628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89897857-82f1-4461-b1d7-cfee91f3fa66 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.105875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1089/2168] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:01.109357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.110603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.110893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.113828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.114528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.115899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.116185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.117845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:01.118159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.119798 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716990c-242d-49e5-b73b-e3a2426fb7c7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.160225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1080/2169] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:01.161823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.162111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.162421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.184122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] MFA Rules not processed for user `403d1846226b494e8ac368f00edb6b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:01.189563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.197959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] MFA Rules not processed for user `caa41ffa48bc4feda62ccee2685547ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:01.198900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.221384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:01.274685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:01.313148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1081/2170] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:01.316379 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.319736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.370649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1090/2171] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:01.370649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.373192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.421270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f2e7-2cc4-4850-bdb0-ebb5a6dc8004 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.425845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.426552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.426869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.427110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.457612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e6ea-d65b-45c0-a515-fa5392630c37 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.461829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.462516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.462799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.463081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.473550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.475024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.487968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1091/2172] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:01.488834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.500234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb099452-7019-4f87-896d-8ae16b490098 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.506956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.507862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.508146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.508429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.509183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.511399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.512121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.514572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.531431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1082/2173] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:01.532421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.533851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.564559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1092/2174] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:01 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:01.565888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.572841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.634543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451455-39e8-41fa-8fe0-8b25a45e7170 service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.683873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20ded3-9eed-4d56-8a4b-92bb4bb53d16 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.688405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.689512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.690725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.691065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.693246 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:01.699768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.700421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.700708 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.700980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.702952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.741934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:01.778140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.781379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.785748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.787289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.795758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1093/2175] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:01.796676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.799916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1083/2176] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:01.800786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:01.802452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:01.916321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87463f42-ad07-4125-92ba-98bb2867bb20 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.923657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.925586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.925894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.926178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] PATH_INFO: `/v3/users/445aaf8abb6445879918f530ac5c1303` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.927643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445aaf8abb6445879918f530ac5c1303)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.931282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.934521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3003f-e2d4-495e-a95b-f1f7eb95499e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:01.948973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:01.949661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:01.950045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:01.950361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:01.951068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:01.961306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:01.991952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1094/2177] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:01 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:01.996824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:02.016047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9456d-8996-4f6c-8e89-92d84f616246 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:02.037395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445aaf8abb6445879918f530ac5c1303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.049670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445aaf8abb6445879918f530ac5c1303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.050397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:02.050929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445aaf8abb6445879918f530ac5c1303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.051761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445aaf8abb6445879918f530ac5c1303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.054184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.054507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.054860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.058028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:02.061384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:02.077944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5d0b0366-83de-40e9-bf13-e49124853c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445aaf8abb6445879918f530ac5c1303'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.098210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1095/2178] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:02.099430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:02.101582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.124180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5ec5-8da8-486a-b501-858d1ccc9128 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:02.130861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:02.131263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.131547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.131823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.132745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:02.134722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:02.155032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1096/2179] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:02.155426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1084/2180] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:01 2022] DELETE /identity/v3/users/445aaf8abb6445879918f530ac5c1303 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:02.156650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:02.183414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d950-83e2-47c9-bb50-4a0765061704 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:02.337904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:02.340747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.341030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.341321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] PATH_INFO: `/v3/projects/8f236e97c75b446587ef97d133f6257e/users/9626d72e987a4056adee897a91b7e464/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.385947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f236e97c75b446587ef97d133f6257e, user_id=9626d72e987a4056adee897a91b7e464, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:02.390495 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:02.417656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1097/2181] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:02 2022] PUT /identity/v3/projects/8f236e97c75b446587ef97d133f6257e/users/9626d72e987a4056adee897a91b7e464/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:02.429412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.429795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.430164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.494806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] MFA Rules not processed for user `9626d72e987a4056adee897a91b7e464`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:02.505074 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:02.505899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.506914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.547826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:02.615615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:02.673245 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5485059-7478-4e22-9bf6-ccd553ef5f6c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:02.674873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1085/2182] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:02.675736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:02.678976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.682811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:02.684111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.684677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.685068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] PATH_INFO: `/v3/projects/777141c138124398b085bda2d651e24f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.686922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=777141c138124398b085bda2d651e24f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:02.689009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:02.760378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca0d80-9c75-4e17-a282-8b90f2e59404 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:02.765799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777141c138124398b085bda2d651e24f', 'request_id': 'req-28ba68af-413f-453b-be31-f4ae7499c33b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.780248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777141c138124398b085bda2d651e24f', 'request_id': 'req-28ba68af-413f-453b-be31-f4ae7499c33b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.794728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777141c138124398b085bda2d651e24f', 'request_id': 'req-28ba68af-413f-453b-be31-f4ae7499c33b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.811526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] The token cache is being invalidate because project 777141c138124398b085bda2d651e24f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:02.812297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.813089 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-28ba68af-413f-453b-be31-f4ae7499c33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:02.815350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1098/2183] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:02 2022] DELETE /identity/v3/projects/777141c138124398b085bda2d651e24f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:02.816602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875f360-21ec-4dee-bca8-e4621d4e5d34 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.817065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875f360-21ec-4dee-bca8-e4621d4e5d34 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.817400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875f360-21ec-4dee-bca8-e4621d4e5d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.830886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:02.832348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.832757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.833137 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.835645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.850429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8875f360-21ec-4dee-bca8-e4621d4e5d34 None None] MFA Rules not processed for user `f01d45401f08406b817d2766a0a5900c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:02.851706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8875f360-21ec-4dee-bca8-e4621d4e5d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.921443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:02.923852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:02.936120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1086/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:02.937274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:02.944843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1099/2185] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:02.946129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:02.946609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:02.946890 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:02.952199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.966302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:02.967626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:02.989261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:03.024322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:03.059784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bc5b5-af5c-4bb7-b0fb-ad38568631de service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.069260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1cc55-1d8d-4656-96a1-a70d4ab9e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.070572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1cc55-1d8d-4656-96a1-a70d4ab9e88d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.077722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1100/2186] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:03.077722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.077722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:03.080177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1cc55-1d8d-4656-96a1-a70d4ab9e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.080840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1cc55-1d8d-4656-96a1-a70d4ab9e88d admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.081619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1cc55-1d8d-4656-96a1-a70d4ab9e88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.083921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1cc55-1d8d-4656-96a1-a70d4ab9e88d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.105785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c2560-7af9-4696-8bf1-febbde93c96e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.121899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.122410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1087/2187] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:02 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:03.122641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.123275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.123561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.124521 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.124909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.125609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.126347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.127745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.152267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:03.153200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:03.171800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1101/2188] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:03.172808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.254665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1088/2189] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:03.255638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.273745 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70de2-b136-46b2-af3d-118412dd31b1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.279302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.280048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.280340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.280621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.280939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c305-d4bf-491a-b6aa-fa1ba99de9ba admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.281396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.284751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.295516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.295516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.295516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.295516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.296069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.296069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.313234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1089/2190] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:03.313234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.331593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b583c-04f0-4e03-ac5e-c1dba5369179 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.338156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.338997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.339270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1102/2191] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:03.339458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.339918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.340445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.340959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:03.341441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.343442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.353142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397568f-08f8-4205-8b8b-e4a68c70eb6b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.359381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.360212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.360769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.361266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.361830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1090/2192] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:03.362476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.362888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.364420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.373693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc4a3-39ca-4319-81d1-759ce27572ed admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.377927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1103/2193] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:03.379003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.387802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.388872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.389312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.389732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.390696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.393674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.403406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad52a8c-a761-4e11-bf76-792b71143551 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.406721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1091/2194] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:03.407711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.412397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.413066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.413349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.413678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.414414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.422637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.422799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff0142-251a-4f72-be11-5d1966407fac admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.427576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.428592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.428885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.429460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] PATH_INFO: `/v3/projects/0e1b0f6591d342d8b06e793e1d5e5308/users/f69539a6c86d4ed89d0766b070dbdc16/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.447723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1b0f6591d342d8b06e793e1d5e5308, user_id=f69539a6c86d4ed89d0766b070dbdc16, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.450416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.465614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1104/2195] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:03.465614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.472111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1092/2196] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:03 2022] PUT /identity/v3/projects/0e1b0f6591d342d8b06e793e1d5e5308/users/f69539a6c86d4ed89d0766b070dbdc16/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:03.473029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.521778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:03.537786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce85715-9778-4a90-9e70-88af0bf0b41b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.545128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.545925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07367c53-7b56-43f5-b2ba-121914b7cd11 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.546037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.546433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.546640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.547479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.549352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.551296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.552486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.552771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.554416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.555556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.557476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.560095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1105/2197] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:03.560984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.574668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0c2f-402d-40dc-9be4-703c2278550a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.580180 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.581641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.581848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.582135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.582924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.584313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1093/2198] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:03.585216 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.586682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.596278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3d37-7158-4b28-95e3-cf2b85f83f27 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.604900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1106/2199] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:03.605315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.605430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.605518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.605518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.605518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] PATH_INFO: `/v3/projects/a15c1943c0d842c4b6f5bf7be7e24036/users/7428661abda54c6ab13b8267ed537bfe/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.615273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ba907-29c9-4316-97d1-a2e2c8c0371d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.622168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.622950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.623423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.623908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.624799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15c1943c0d842c4b6f5bf7be7e24036, user_id=7428661abda54c6ab13b8267ed537bfe, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.625098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.626813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.628412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.630091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:03.645949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1107/2200] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:03.647047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.648329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1094/2201] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:03 2022] PUT /identity/v3/projects/a15c1943c0d842c4b6f5bf7be7e24036/users/7428661abda54c6ab13b8267ed537bfe/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:03.649974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.666355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979c68b-dbe4-4d30-81d8-a9882134fc31 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.733645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf3b2-0005-449d-a98b-69af91f97313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.734767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf3b2-0005-449d-a98b-69af91f97313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.735057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf3b2-0005-449d-a98b-69af91f97313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.735343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf3b2-0005-449d-a98b-69af91f97313 admin admin] PATH_INFO: `/v3/projects/0e1b0f6591d342d8b06e793e1d5e5308/users/f69539a6c86d4ed89d0766b070dbdc16/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.738188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf3b2-0005-449d-a98b-69af91f97313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1b0f6591d342d8b06e793e1d5e5308, user_id=f69539a6c86d4ed89d0766b070dbdc16, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.740840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf3b2-0005-449d-a98b-69af91f97313 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.742691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064c01-d32f-4881-b16e-b53b1ab85f3f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.748022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.748705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.748996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.749534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.750308 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.751920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.766895 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1108/2202] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:03 2022] PUT /identity/v3/projects/0e1b0f6591d342d8b06e793e1d5e5308/users/f69539a6c86d4ed89d0766b070dbdc16/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:03.768471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.768756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.769036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.780224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1095/2203] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:03.781516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.793045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d438b7-45b6-46ee-a074-a138eb109a65 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.802658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] MFA Rules not processed for user `7428661abda54c6ab13b8267ed537bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:03.804561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:03.861291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e05628-a4ec-435d-a560-1fb8cb38dd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:03.863333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05628-a4ec-435d-a560-1fb8cb38dd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.863333 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05628-a4ec-435d-a560-1fb8cb38dd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.863527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e05628-a4ec-435d-a560-1fb8cb38dd71 admin admin] PATH_INFO: `/v3/projects/2abe00d76fdf4d958fc1256c5123b069/users/721196c95841441cae4b48022d6e0d30/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.887782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e05628-a4ec-435d-a560-1fb8cb38dd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abe00d76fdf4d958fc1256c5123b069, user_id=721196c95841441cae4b48022d6e0d30, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:03.890717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e05628-a4ec-435d-a560-1fb8cb38dd71 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:03.909397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1096/2204] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:03 2022] PUT /identity/v3/projects/2abe00d76fdf4d958fc1256c5123b069/users/721196c95841441cae4b48022d6e0d30/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:03.914643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:03.914953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:03.915207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:03.934353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1109/2205] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:03.935281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:03.941696 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:03.944260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:03.961785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cbe47-8df7-46d0-8d42-aed03a1d855c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:03.967032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:04.037473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1097/2206] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:04.049882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.051655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:04.061187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.061730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.062140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.063202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.063665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.065644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.098340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1110/2207] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:03 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:04.100059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.106635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:04.126978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173b2ca-0e6a-47cd-8de8-eb4528a2a59e None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:04.231166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.231858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.232175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.232984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.245162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.245475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e27bd3-1c14-48ef-97f4-d207c3d1e9b9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:04.246752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.262878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.263583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.264214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.264214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.264952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.266992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.278250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1098/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:11:04.313418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1111/2209] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:04 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:04.323199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.339955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f7f42-c8a0-4716-90f1-44ad6e7175e6 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:04.364412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.364412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.364412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.364412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.364789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.364789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.377721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1099/2210] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:04.378959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.394615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0da0fb-2a9f-4914-b9b2-402d863c6cd8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:04.410400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.412231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.412756 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.413662 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] PATH_INFO: `/v3/projects/916b2696d2a348be85fd8c4a1cecd71c/users/b3e0f5983b0e448297979cb002ab37c1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.437321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916b2696d2a348be85fd8c4a1cecd71c, user_id=b3e0f5983b0e448297979cb002ab37c1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.442963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.466524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1112/2211] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:04 2022] PUT /identity/v3/projects/916b2696d2a348be85fd8c4a1cecd71c/users/b3e0f5983b0e448297979cb002ab37c1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:04.470906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.494036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59bb12-64d6-4976-96c9-f4a238436e03 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:04.630575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dab014-188f-4627-bbed-abd25ebccfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.631561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab014-188f-4627-bbed-abd25ebccfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.632064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab014-188f-4627-bbed-abd25ebccfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.632618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab014-188f-4627-bbed-abd25ebccfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.633471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dab014-188f-4627-bbed-abd25ebccfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.635234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dab014-188f-4627-bbed-abd25ebccfa7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.652390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1100/2212] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:04.656179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.671427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60897-7bb6-4bf4-8184-8da63ac021a3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:04.676352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad8505-0fe6-4a75-94dd-b204693cd920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:04.677391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8505-0fe6-4a75-94dd-b204693cd920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.677676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8505-0fe6-4a75-94dd-b204693cd920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.678282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad8505-0fe6-4a75-94dd-b204693cd920 admin admin] PATH_INFO: `/v3/projects/916b2696d2a348be85fd8c4a1cecd71c/users/b3e0f5983b0e448297979cb002ab37c1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.680754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad8505-0fe6-4a75-94dd-b204693cd920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916b2696d2a348be85fd8c4a1cecd71c, user_id=b3e0f5983b0e448297979cb002ab37c1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:04.683145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad8505-0fe6-4a75-94dd-b204693cd920 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:04.696689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1113/2213] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:04 2022] PUT /identity/v3/projects/916b2696d2a348be85fd8c4a1cecd71c/users/b3e0f5983b0e448297979cb002ab37c1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:04.708529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.708969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.709322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.766880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:04.779740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] MFA Rules not processed for user `b3e0f5983b0e448297979cb002ab37c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:04.782011 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:04.867392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878157-189b-4892-b630-928d6af26478 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:04.868609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878157-189b-4892-b630-928d6af26478 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:04.868900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878157-189b-4892-b630-928d6af26478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:04.936664 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4b878157-189b-4892-b630-928d6af26478 None None] MFA Rules not processed for user `f69539a6c86d4ed89d0766b070dbdc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:04.937903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b878157-189b-4892-b630-928d6af26478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:04.959951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1101/2214] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:04.974719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:04.976998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:05.125841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1114/2215] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:05.138447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:05.138755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:05.139092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:05.143459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920151e-9f58-4d99-a41a-fead6c107c10 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:05.148702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:05.152328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:05.152780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:05.153759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:05.164483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] MFA Rules not processed for user `f01d45401f08406b817d2766a0a5900c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:05.166642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:05.170255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:05.170255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:05.194584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1102/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:05.223534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:05.255634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1115/2217] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:05.266842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:05.268460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:05.372457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff38c1c-5a26-4e1e-b38d-14f478dc6135 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:05.379962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:05.380793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:05.381288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:05.381668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:05.392134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:05.394183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:05.407638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1103/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:05.940499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:05.942525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:06.116490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b6008-79ec-4369-9f3e-882bc8f58548 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:06.135046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:06.147516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:06.148087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:06.149770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] PATH_INFO: `/v3/users/8e49d122b4a945a8b4cb53dd0edc0f1d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:06.151231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e49d122b4a945a8b4cb53dd0edc0f1d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:06.153842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:06.240953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:06.251646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e49d122b4a945a8b4cb53dd0edc0f1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.254098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880ecf0-869f-47fa-8d2d-633e97018a86 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:06.258080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:06.258914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:06.259203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:06.259477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:06.263044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:06.263428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e49d122b4a945a8b4cb53dd0edc0f1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.264326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e49d122b4a945a8b4cb53dd0edc0f1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.276388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e49d122b4a945a8b4cb53dd0edc0f1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.278119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f36c8647-4e7d-4292-95f4-995f6b969572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e49d122b4a945a8b4cb53dd0edc0f1d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.304688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:06.331032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1116/2219] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:05 2022] DELETE /identity/v3/users/8e49d122b4a945a8b4cb53dd0edc0f1d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:06.334841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:06.335131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:06.337580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:06.360176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:06.361450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:06.390802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:06.392867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:06.427505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1104/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:11:06.439243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:06.441769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:06.464122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0fd4-6ce3-449b-b76b-0b5eeff32554 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:06.531844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1117/2221] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:06.533459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:06.535023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:06.546077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:06.582064 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:06.584243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:06.584990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:06.584990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] PATH_INFO: `/v3/users/f044e708e0804aefb3a6e4c824a729d5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:06.587543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f044e708e0804aefb3a6e4c824a729d5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:06.593017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:06.643815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d277e-16a6-4632-b979-d52d3c0057cf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:06.649128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3983ec-5327-4190-94db-b2d9eca7b887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:06.650032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3983ec-5327-4190-94db-b2d9eca7b887 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:06.650427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3983ec-5327-4190-94db-b2d9eca7b887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:06.650821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3983ec-5327-4190-94db-b2d9eca7b887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:06.670036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3983ec-5327-4190-94db-b2d9eca7b887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:06.671846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3983ec-5327-4190-94db-b2d9eca7b887 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:06.688973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1118/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:06.706106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f044e708e0804aefb3a6e4c824a729d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.721179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f044e708e0804aefb3a6e4c824a729d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.722025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f044e708e0804aefb3a6e4c824a729d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.722867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f044e708e0804aefb3a6e4c824a729d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.740448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f044e708e0804aefb3a6e4c824a729d5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:06.790372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1105/2223] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:06 2022] DELETE /identity/v3/users/f044e708e0804aefb3a6e4c824a729d5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:06.794950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:06.795240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:06.795518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:06.828023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:06.829350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:06.972278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1119/2224] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:06.997710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:07.000775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:07.035859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:07.037058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:07.132599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081a108-564e-4b1e-9e04-62c5128c6e96 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:07.136627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:07.137282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:07.137646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:07.137930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:07.139951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:07.154927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:07.188925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e15f7-e197-4512-9c05-c915b678db61 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:07.193948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:07.194645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:07.194917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:07.195193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:07.205033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:07.206534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:07.224302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1106/2225] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:07.285987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:07.287900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:07.309874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:07.316912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1120/2226] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:07.797510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:07.799231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:07.825368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81564314-0764-4261-8492-5f6553fb4e18 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:07.861523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:07.862574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:07.862970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:07.863758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] PATH_INFO: `/v3/projects/8f75996f180348119570c8f441ad7b74` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:07.865280 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f75996f180348119570c8f441ad7b74)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:07.867503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:07.955949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:07.957613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:08.005478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997375-8e17-4ade-a574-ccef606f3354 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:08.055483 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f75996f180348119570c8f441ad7b74', 'request_id': 'req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.074773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f75996f180348119570c8f441ad7b74', 'request_id': 'req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.092516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f75996f180348119570c8f441ad7b74', 'request_id': 'req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.118271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] The token cache is being invalidate because project 8f75996f180348119570c8f441ad7b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:08.119277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.122199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.130666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1107/2227] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:07 2022] DELETE /identity/v3/projects/8f75996f180348119570c8f441ad7b74 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:08.131618 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:08.134195 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:08.193104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:08.194501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:08.194922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:08.195357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] PATH_INFO: `/v3/projects/5ecbe2ca5e384fcab52527173ad6555d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:08.203163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecbe2ca5e384fcab52527173ad6555d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:08.205349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:08.258259 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc80a20-bcb8-4c11-b8ee-cd1e204c34a9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:08.261637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:08.262716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:08.263105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:08.263492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] PATH_INFO: `/v3/users/f202e4fff4be498bba5c022732bf3531` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:08.265732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f202e4fff4be498bba5c022732bf3531)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:08.268509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:08.344896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecbe2ca5e384fcab52527173ad6555d', 'request_id': 'req-f7135761-26bc-4c3b-b4a3-af3010290472'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.370983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecbe2ca5e384fcab52527173ad6555d', 'request_id': 'req-f7135761-26bc-4c3b-b4a3-af3010290472'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.394096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f202e4fff4be498bba5c022732bf3531'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.397240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecbe2ca5e384fcab52527173ad6555d', 'request_id': 'req-f7135761-26bc-4c3b-b4a3-af3010290472'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.415157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f202e4fff4be498bba5c022732bf3531'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.416949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f202e4fff4be498bba5c022732bf3531'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.419723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f202e4fff4be498bba5c022732bf3531'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.434732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] The token cache is being invalidate because project 5ecbe2ca5e384fcab52527173ad6555d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:08.437233 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.437975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.442185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1121/2228] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:07 2022] DELETE /identity/v3/projects/5ecbe2ca5e384fcab52527173ad6555d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:08.445906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:08.447936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:08.451079 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:08.469446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f202e4fff4be498bba5c022732bf3531'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.499790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1108/2229] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:08 2022] DELETE /identity/v3/users/f202e4fff4be498bba5c022732bf3531 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:08.607103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7135761-26bc-4c3b-b4a3-af3010290472 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:08.671751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:08.718151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:08.726325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:08.726325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:08.726325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] PATH_INFO: `/v3/users/403d1846226b494e8ac368f00edb6b76` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:08.727903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=403d1846226b494e8ac368f00edb6b76)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:08.729865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:08.853106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403d1846226b494e8ac368f00edb6b76'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.864572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403d1846226b494e8ac368f00edb6b76'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.865604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403d1846226b494e8ac368f00edb6b76'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.875692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403d1846226b494e8ac368f00edb6b76'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.877028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5b9dbaa6-2fa9-4e12-a0c8-2b95e42d31d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403d1846226b494e8ac368f00edb6b76'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:08.921627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1122/2230] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:08 2022] DELETE /identity/v3/users/403d1846226b494e8ac368f00edb6b76 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:09.278090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:09.280185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:09.303664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1492a8-e5cb-4c62-9908-d3d44e25159b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:09.422481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:09.423904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:09.424273 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:09.424943 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] PATH_INFO: `/v3/projects/240ac545cce3449ebac5a79528297842` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:09.427062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240ac545cce3449ebac5a79528297842)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:09.429932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:09.612760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240ac545cce3449ebac5a79528297842', 'request_id': 'req-336b5c5b-5553-4de4-bf9b-26dd45614800'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:09.635070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240ac545cce3449ebac5a79528297842', 'request_id': 'req-336b5c5b-5553-4de4-bf9b-26dd45614800'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:09.652777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240ac545cce3449ebac5a79528297842', 'request_id': 'req-336b5c5b-5553-4de4-bf9b-26dd45614800'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:09.681892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] The token cache is being invalidate because project 240ac545cce3449ebac5a79528297842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:09.682621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:09.685091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:09.687716 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1109/2231] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:09 2022] DELETE /identity/v3/projects/240ac545cce3449ebac5a79528297842 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:09.693254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5713-a31d-461b-9b8b-d519cd310190 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:09.696181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5713-a31d-461b-9b8b-d519cd310190 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:09.697508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f5713-a31d-461b-9b8b-d519cd310190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:09.733107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6a3f5713-a31d-461b-9b8b-d519cd310190 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:09.735948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a3f5713-a31d-461b-9b8b-d519cd310190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:09.785555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:09.788615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:09.919031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1123/2232] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:09.921503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:09.921795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:09.922081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:09.962760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b5c5b-5553-4de4-bf9b-26dd45614800 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:09.965975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:09.967508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:09.968221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:09.969400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:09.969728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:09.970090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] PATH_INFO: `/v3/projects/315ee2c27801477fb51d688e317c8d68` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:09.971845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=315ee2c27801477fb51d688e317c8d68)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:09.974100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:09.986077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1124/2233] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:09.988544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.003523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:10.012790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37ffd2-f241-43e0-85a8-83722392f3f5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.020054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.027987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.028947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.029397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.030318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:10.031019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.033701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.053936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1125/2234] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:10.056205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.067909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bb0ff-afb5-4741-bf99-79c596e9f1bc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.071338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315ee2c27801477fb51d688e317c8d68', 'request_id': 'req-fa283fe3-cad8-4691-bbe2-1b283e148307'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:10.088573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315ee2c27801477fb51d688e317c8d68', 'request_id': 'req-fa283fe3-cad8-4691-bbe2-1b283e148307'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:10.104247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315ee2c27801477fb51d688e317c8d68', 'request_id': 'req-fa283fe3-cad8-4691-bbe2-1b283e148307'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:10.121009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:10.127439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] The token cache is being invalidate because project 315ee2c27801477fb51d688e317c8d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:10.129281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:10.130112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-fa283fe3-cad8-4691-bbe2-1b283e148307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:10.138717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1110/2235] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:09 2022] DELETE /identity/v3/projects/315ee2c27801477fb51d688e317c8d68 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:10.141890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a135-9b54-4d95-bc8b-61005454b572 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.142311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a135-9b54-4d95-bc8b-61005454b572 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.143861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10a135-9b54-4d95-bc8b-61005454b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.180695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.181474 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.181852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.183024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.183740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9f10a135-9b54-4d95-bc8b-61005454b572 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:10.184453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.185789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9f10a135-9b54-4d95-bc8b-61005454b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:10.187937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.215329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1111/2236] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:10.218184 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.218497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.218808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.258705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1126/2237] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/projects => generated 399 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:10.262212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.263898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:10.268356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:10.270755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:10.433527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1112/2238] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:10.438403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.448571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca8c91-54b7-43ed-a3c0-f3a541df0ac4 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.465865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.467376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.467857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.468467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.469415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:10.469920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.472880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.476061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867426e2-307f-4176-a927-dbc258f307ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.487607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1113/2239] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:11:10.492867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.494270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.494576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.494869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.495170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.495711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.498624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.518426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281a1c5-e76d-434e-b7e8-71ae84db4da2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.541783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.545122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1127/2240] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:10.545367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.545367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.545367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.545367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.546316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.549877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.566260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615746cf-aa58-4e45-8850-3ab1dc5956f5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.573989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.574908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.575192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.576190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.577134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.578648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.595570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1128/2241] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:10.598188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.612869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cee142-3034-4daa-a784-630769d6961f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.632623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1114/2242] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:11:10.632837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.632837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.632837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.632837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.633131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.634353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.641923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.653058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1129/2243] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:10.655084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:10.669541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8938cfc-68a0-45ff-ab88-b6cd35e8c890 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.748124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf97db-76ba-447b-9a78-cbbf3bae8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.749316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf97db-76ba-447b-9a78-cbbf3bae8508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.749990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf97db-76ba-447b-9a78-cbbf3bae8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.750401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf97db-76ba-447b-9a78-cbbf3bae8508 admin admin] PATH_INFO: `/v3/projects/9de886d636ee47d0b59d8dae9df49c85/users/b7f59528d60e4e8ebba549e37bcfdf87/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.774430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf97db-76ba-447b-9a78-cbbf3bae8508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de886d636ee47d0b59d8dae9df49c85, user_id=b7f59528d60e4e8ebba549e37bcfdf87, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.778732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf97db-76ba-447b-9a78-cbbf3bae8508 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:10.797941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1130/2244] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:10 2022] PUT /identity/v3/projects/9de886d636ee47d0b59d8dae9df49c85/users/b7f59528d60e4e8ebba549e37bcfdf87/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:10.798751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423765a-0b51-4da4-88d7-c10a263fd897 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:10.808838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.809213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.810416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.826936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:10.843101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:10.849176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] MFA Rules not processed for user `b7f59528d60e4e8ebba549e37bcfdf87`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:10.855374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:10.967548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:10.968245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:10.972156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:10.972446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:10.973239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:10.979027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.000317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1131/2245] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:11.002576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.022877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1115/2246] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:10 2022] POST /identity/v3/users => generated 284 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:11.024373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9b76-ae8a-4fe9-ac4e-41e6ccd88f94 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.032186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.037482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.048794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba0e13-f931-45e1-8f54-8debfde9f23e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.060883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.061587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.062100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.067131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.072123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.082328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.083441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.090302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.090540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.091914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.093849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.106935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1116/2247] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:11.110880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.131966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279b8e-b999-40bc-a21c-ce3724c6a336 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.138331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1132/2248] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:11 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:11.143527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.163282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.164057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.164343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.165065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.165646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.167587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.186270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1117/2249] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:11.190768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.207853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b8426-06e7-470b-9e02-76de4f478a09 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.299998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30ed58-7502-4ba0-a12a-4b5e6e53d455 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.314039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.316576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.316988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.317386 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.318300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.320530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.348929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91a8ed-901a-4d91-b010-6a9e1996fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.350347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91a8ed-901a-4d91-b010-6a9e1996fc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.350347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91a8ed-901a-4d91-b010-6a9e1996fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.350666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91a8ed-901a-4d91-b010-6a9e1996fc7e admin admin] PATH_INFO: `/v3/projects/f935c015e77f4e2292db45812d1b49ad/users/9754b86ef0fd462b9162775d842963a5/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.375227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91a8ed-901a-4d91-b010-6a9e1996fc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f935c015e77f4e2292db45812d1b49ad, user_id=9754b86ef0fd462b9162775d842963a5, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.378797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91a8ed-901a-4d91-b010-6a9e1996fc7e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.393869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1133/2250] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:11 2022] POST /identity/v3/users => generated 307 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:11.394901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.415969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1118/2251] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:11 2022] PUT /identity/v3/projects/f935c015e77f4e2292db45812d1b49ad/users/9754b86ef0fd462b9162775d842963a5/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:11.429395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d58a-fecb-439e-ac63-40586080a25a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.432938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.433436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.434047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.543130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] MFA Rules not processed for user `9754b86ef0fd462b9162775d842963a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:11.544385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:11.572570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.573275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.573580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.573829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.574605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.576234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.597342 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1134/2252] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:11.601467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.607562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:11.628384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:11.693914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:11.723925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1119/2253] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:11.724800 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.754101 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e87b1-c26e-4f52-bf6b-f62ceb018396 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.758378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1017a9-e6d4-41d4-b28a-96596d0d9e6e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:11.758881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.759604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.759919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.760190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] PATH_INFO: `/v3/projects/421cf32787704a999791126b9a11ab6d/users/359cc1e54c7143b89f7646f2922b5228/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.767734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:11.768285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:11.769813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:11.769813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:11.775006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:11.797078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=421cf32787704a999791126b9a11ab6d, user_id=359cc1e54c7143b89f7646f2922b5228, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.800438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.855245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1120/2254] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:11 2022] PUT /identity/v3/projects/421cf32787704a999791126b9a11ab6d/users/359cc1e54c7143b89f7646f2922b5228/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:11.856130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.859354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:11.956024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:11.957498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:11.978025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1135/2255] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:11.978996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:11.999897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a942-9416-4ff3-b433-d3da7342f116 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:12.001983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c010-e25f-4677-9aa4-3f26837a2b5c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:12.010948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b5825-c55b-4fb4-a0c5-5e1f626ca99c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:12.011688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5825-c55b-4fb4-a0c5-5e1f626ca99c service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:12.011975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5825-c55b-4fb4-a0c5-5e1f626ca99c service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:12.012253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5825-c55b-4fb4-a0c5-5e1f626ca99c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:12.130910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:12.132404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:12.132932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:12.133410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:12.134960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:12.139266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:12.162412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1136/2256] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:12.170878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:12.174640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5825-c55b-4fb4-a0c5-5e1f626ca99c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:12.176519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b5825-c55b-4fb4-a0c5-5e1f626ca99c service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:12.188420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1121/2257] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:12.212663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5ae16-8636-44c6-b87b-1eede515de74 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:12.228070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:12.229875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:12.232942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:12.253706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] PATH_INFO: `/v3/projects/421cf32787704a999791126b9a11ab6d/users/359cc1e54c7143b89f7646f2922b5228/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:12.258068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=421cf32787704a999791126b9a11ab6d, user_id=359cc1e54c7143b89f7646f2922b5228, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:12.260874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:12.296265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1137/2258] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:12 2022] PUT /identity/v3/projects/421cf32787704a999791126b9a11ab6d/users/359cc1e54c7143b89f7646f2922b5228/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:12.299825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:12.299825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:12.299825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:12.354487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] MFA Rules not processed for user `359cc1e54c7143b89f7646f2922b5228`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:12.356782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:12.575546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1122/2259] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:13.032782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:13.035396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.055885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:13.058155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.076048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:13.157415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:13.183568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c95f6-caa6-40b1-a4d7-156d6d6d12ee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:13.194068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960179-cd92-4a0c-9c54-7fb9dc62ae48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:13.195138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960179-cd92-4a0c-9c54-7fb9dc62ae48 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.195567 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960179-cd92-4a0c-9c54-7fb9dc62ae48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.195857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960179-cd92-4a0c-9c54-7fb9dc62ae48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.209539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960179-cd92-4a0c-9c54-7fb9dc62ae48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:13.218321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960179-cd92-4a0c-9c54-7fb9dc62ae48 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:13.218405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6169a24-d90a-4e49-948b-baaa1ef51171 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:13.227464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:13.229276 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.229722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.230154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] PATH_INFO: `/v3/users/aaa319ce8f774558b4512a8ff9e6f2b1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.232326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1138/2260] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:13.232638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa319ce8f774558b4512a8ff9e6f2b1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:13.236209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:13.242053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa3ef-d843-459f-9c95-bcf62fa60f3a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.242284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa3ef-d843-459f-9c95-bcf62fa60f3a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.242561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa3ef-d843-459f-9c95-bcf62fa60f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.333276 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa319ce8f774558b4512a8ff9e6f2b1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:13.338318 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-879fa3ef-d843-459f-9c95-bcf62fa60f3a None None] MFA Rules not processed for user `721196c95841441cae4b48022d6e0d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:13.339859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-879fa3ef-d843-459f-9c95-bcf62fa60f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.349356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa319ce8f774558b4512a8ff9e6f2b1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:13.351140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa319ce8f774558b4512a8ff9e6f2b1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:13.351797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa319ce8f774558b4512a8ff9e6f2b1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:13.368339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa319ce8f774558b4512a8ff9e6f2b1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:13.391860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1123/2261] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:13 2022] DELETE /identity/v3/users/aaa319ce8f774558b4512a8ff9e6f2b1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:13.396338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:13.399667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.514251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1139/2262] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:13.514251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.514251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.514251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.518458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250158-9244-4dcb-aca9-8b93d88e9ad4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:13.527730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:13.528614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.529031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.529446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.534348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.596512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:13.597785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.630871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:13.701023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:13.702638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:13.721536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1124/2263] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:13.722526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:13.724257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.737961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1140/2264] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:13.768614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:13.770516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:13.899409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7ea74-e448-42f1-92b1-8d63bb4785a7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:13.905347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83dc3e-4462-49ec-a29c-7f6fa1340d6b service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:13.912237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:13.913292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.913768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.913886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:13.914247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.914580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:13.914867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:13.915146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:13.934213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:13.935853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:13.983695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1141/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:14.034541 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:14.037016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:14.077587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1125/2266] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:14.687426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:14.688974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:14.704154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28966031-4b0e-4326-80b3-b412d0aa3d67 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:14.711285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:14.713027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:14.713454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:14.713743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] PATH_INFO: `/v3/projects/4970b9faf2514a2c95291a27956815d9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:14.715522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4970b9faf2514a2c95291a27956815d9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:14.732744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:14.760215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:14.807922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4970b9faf2514a2c95291a27956815d9', 'request_id': 'req-31688e47-5ddf-4cc1-bb8c-97217890f323'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:14.817437 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4970b9faf2514a2c95291a27956815d9', 'request_id': 'req-31688e47-5ddf-4cc1-bb8c-97217890f323'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:14.831384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4970b9faf2514a2c95291a27956815d9', 'request_id': 'req-31688e47-5ddf-4cc1-bb8c-97217890f323'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:14.855328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] The token cache is being invalidate because project 4970b9faf2514a2c95291a27956815d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:14.855919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:14.856810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:14.859570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1142/2267] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:14 2022] DELETE /identity/v3/projects/4970b9faf2514a2c95291a27956815d9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:14.863819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:14.880222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4b72c-ac9e-4345-9870-c151cc3affaf service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:15.001061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:15.006675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:15.007594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:15.009625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] PATH_INFO: `/v3/users/caa41ffa48bc4feda62ccee2685547ed` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:15.012527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa41ffa48bc4feda62ccee2685547ed)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:15.034643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:15.084017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:15.130643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa41ffa48bc4feda62ccee2685547ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.138948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa41ffa48bc4feda62ccee2685547ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.139199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa41ffa48bc4feda62ccee2685547ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.139824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa41ffa48bc4feda62ccee2685547ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.161477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-22affd9f-6a91-4bcb-9844-400b788afb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa41ffa48bc4feda62ccee2685547ed'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.181221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1126/2268] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:14 2022] DELETE /identity/v3/users/caa41ffa48bc4feda62ccee2685547ed => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:15.241147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:15.243370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:15.276289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31688e47-5ddf-4cc1-bb8c-97217890f323 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:15.440511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:15.443540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:15.446931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:15.447335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] PATH_INFO: `/v3/users/9626d72e987a4056adee897a91b7e464` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:15.451724 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9626d72e987a4056adee897a91b7e464)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:15.455827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:15.592820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9626d72e987a4056adee897a91b7e464'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.608544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9626d72e987a4056adee897a91b7e464'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.613418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9626d72e987a4056adee897a91b7e464'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.644586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9626d72e987a4056adee897a91b7e464'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.645460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9626d72e987a4056adee897a91b7e464'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:15.691565 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1143/2269] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:15 2022] DELETE /identity/v3/users/9626d72e987a4056adee897a91b7e464 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:15.694467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:15.694929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:15.695387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:15.720668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:15.722780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:15.812057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1127/2270] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:15.827196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:15.829849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:15.894532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:15.958626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d78e6-b917-454d-a0ff-97e998ea5102 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:15.965418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08675398-d9f8-42b0-8d0b-7202fcf02b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:15.966093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675398-d9f8-42b0-8d0b-7202fcf02b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:15.966411 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675398-d9f8-42b0-8d0b-7202fcf02b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:15.966692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08675398-d9f8-42b0-8d0b-7202fcf02b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:15.988270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675398-d9f8-42b0-8d0b-7202fcf02b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:15.989464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08675398-d9f8-42b0-8d0b-7202fcf02b39 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:16.003523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1144/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:16.070408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:16.076112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:16.132121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e82cd-7cca-409a-9c06-6b0eb65b65fb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:16.161353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:16.163519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.163936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.164303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] PATH_INFO: `/v3/projects/969c0741163747f59b52de18595c033b` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.166938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969c0741163747f59b52de18595c033b)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:16.177262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:16.267567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969c0741163747f59b52de18595c033b', 'request_id': 'req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:16.275617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969c0741163747f59b52de18595c033b', 'request_id': 'req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:16.282893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969c0741163747f59b52de18595c033b', 'request_id': 'req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:16.310089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] The token cache is being invalidate because project 969c0741163747f59b52de18595c033b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:16.310457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:16.311351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-5e1af053-ac26-43c8-a704-5c4a25dd2cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:16.315529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1128/2272] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:16 2022] DELETE /identity/v3/projects/969c0741163747f59b52de18595c033b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:16.321497 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.321828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.322143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.356275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:16.357856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:16.530014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.530014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.530014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.539893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1145/2273] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:16.573816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:16.575409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:16.597830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1129/2274] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:16.602322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:16.616170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c48a6-233a-4e07-bd38-9aaec18e7bed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:16.630416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:16.631095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.631374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.631650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.632638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:16.632953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:16.636843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac49efc-47ad-4892-b205-915705e8f230 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:16.672394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:16.683965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602658c4-d9f6-4fec-9910-c68a40766001 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:16.684959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1146/2275] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:16.700915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:16.701608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.701940 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.702202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.702896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:16.704838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:16.744561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:16.746523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.747045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.747457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.785553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1130/2276] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:16 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:16.791426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] MFA Rules not processed for user `721196c95841441cae4b48022d6e0d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:16.792310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:16.794400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:16.906010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e0d7-46bf-44cb-aa0c-ab819c52a3e7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:16.913422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:16.914392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:16.914997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:16.915582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:16.917732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:16.920764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:16.965493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1147/2277] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:16.978314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1131/2278] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:16 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:16.981578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:16.994122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:17.004764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:17.020085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4495b3-2378-443e-b0f3-eb3e3c14da2e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:17.027478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d923496-3a61-4ba7-bf98-ee0fb6353529 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:17.034798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:17.035655 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.035885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.037523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:17.038536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:17.042773 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:17.058636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:17.059827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.060221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.060632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] PATH_INFO: `/v3/projects/8f236e97c75b446587ef97d133f6257e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:17.065506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f236e97c75b446587ef97d133f6257e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:17.074266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:17.074917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1148/2279] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:17.078377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:17.102706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11cb5f-46f5-4ddb-a409-a8550354a524 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:17.114550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:17.115329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.115508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.115788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:17.116626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:17.122126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:17.156549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1149/2280] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:17.161068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:17.197073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5e89-3052-47a1-a704-11837613fc15 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:17.199311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f236e97c75b446587ef97d133f6257e', 'request_id': 'req-0d7b44ca-266d-4777-a970-fe2a1a797c5c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.206575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f236e97c75b446587ef97d133f6257e', 'request_id': 'req-0d7b44ca-266d-4777-a970-fe2a1a797c5c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.213683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f236e97c75b446587ef97d133f6257e', 'request_id': 'req-0d7b44ca-266d-4777-a970-fe2a1a797c5c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.233780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] The token cache is being invalidate because project 8f236e97c75b446587ef97d133f6257e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:17.235575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.252648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.257849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1132/2281] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:16 2022] DELETE /identity/v3/projects/8f236e97c75b446587ef97d133f6257e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:17.258908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:17.260519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:17.318766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:17.394492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e1460-485e-43ac-b1fd-f4710c5e5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:17.395714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e1460-485e-43ac-b1fd-f4710c5e5ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.396928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e1460-485e-43ac-b1fd-f4710c5e5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.397218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e1460-485e-43ac-b1fd-f4710c5e5ea6 admin admin] PATH_INFO: `/v3/projects/eab1752433084f36948a78d3d410e191/users/cd46670078334b8db10e7d1710e967a0/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:17.415437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b44ca-266d-4777-a970-fe2a1a797c5c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:17.425369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:17.427614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.428010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.428303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] PATH_INFO: `/v3/users/7428661abda54c6ab13b8267ed537bfe` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:17.429950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7428661abda54c6ab13b8267ed537bfe)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:17.432329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:17.434346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e1460-485e-43ac-b1fd-f4710c5e5ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab1752433084f36948a78d3d410e191, user_id=cd46670078334b8db10e7d1710e967a0, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:17.440069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:17.443697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e1460-485e-43ac-b1fd-f4710c5e5ea6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:17.500498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1150/2282] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:17 2022] PUT /identity/v3/projects/eab1752433084f36948a78d3d410e191/users/cd46670078334b8db10e7d1710e967a0/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:17.510842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.511307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.513370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:17.572901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7428661abda54c6ab13b8267ed537bfe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.583847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7428661abda54c6ab13b8267ed537bfe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.593030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7428661abda54c6ab13b8267ed537bfe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.593939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7428661abda54c6ab13b8267ed537bfe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.618534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] MFA Rules not processed for user `cd46670078334b8db10e7d1710e967a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:17.622401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:17.637980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7428661abda54c6ab13b8267ed537bfe'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:17.727986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1133/2283] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:17 2022] DELETE /identity/v3/users/7428661abda54c6ab13b8267ed537bfe => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:17.779304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1151/2284] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:17.792139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:17.793594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:17.938488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc2889-2901-43f7-8e65-7061d256a092 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:17.947153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:17.948597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:17.949926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:17.950397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:18.071909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:18.075119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:18.092905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1134/2285] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:18.322589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:18.324095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:18.508540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e00f1-dd3c-4b6e-8e76-892adb5483e0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:18.772802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:18.792577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:18.793618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:18.793887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:18.794163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] PATH_INFO: `/v3/projects/a15c1943c0d842c4b6f5bf7be7e24036` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:18.798150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15c1943c0d842c4b6f5bf7be7e24036)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:18.800783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:18.915835 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:18.917568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:18.947262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b035df-0388-49de-88a1-5493804fb3b6 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:18.961698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15c1943c0d842c4b6f5bf7be7e24036', 'request_id': 'req-54917804-5358-4744-a31f-5e373313ba10'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:18.975672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15c1943c0d842c4b6f5bf7be7e24036', 'request_id': 'req-54917804-5358-4744-a31f-5e373313ba10'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:18.985507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15c1943c0d842c4b6f5bf7be7e24036', 'request_id': 'req-54917804-5358-4744-a31f-5e373313ba10'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.003869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] The token cache is being invalidate because project a15c1943c0d842c4b6f5bf7be7e24036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:19.004175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.004837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.006646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1152/2286] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:18 2022] DELETE /identity/v3/projects/a15c1943c0d842c4b6f5bf7be7e24036 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:19.011562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:19.020640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:19.034018 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:19.063718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:19.064918 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:19.065221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:19.066044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] PATH_INFO: `/v3/users/b7f59528d60e4e8ebba549e37bcfdf87` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:19.068750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f59528d60e4e8ebba549e37bcfdf87)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:19.072514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:19.112712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54917804-5358-4744-a31f-5e373313ba10 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:19.117795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:19.119027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:19.119535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:19.119963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] PATH_INFO: `/v3/users/b3e0f5983b0e448297979cb002ab37c1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:19.121491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e0f5983b0e448297979cb002ab37c1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:19.123514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:19.151598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f59528d60e4e8ebba549e37bcfdf87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.165660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f59528d60e4e8ebba549e37bcfdf87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.166559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f59528d60e4e8ebba549e37bcfdf87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.167647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f59528d60e4e8ebba549e37bcfdf87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.185866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a1f0dd52-a29a-4d00-883e-4ddda2a3bff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f59528d60e4e8ebba549e37bcfdf87'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.205137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e0f5983b0e448297979cb002ab37c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.207974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1135/2287] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:18 2022] DELETE /identity/v3/users/b7f59528d60e4e8ebba549e37bcfdf87 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:19.212976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:19.213527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:19.213816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:19.215405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e0f5983b0e448297979cb002ab37c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.216244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e0f5983b0e448297979cb002ab37c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.228261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e0f5983b0e448297979cb002ab37c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.229019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e0f5983b0e448297979cb002ab37c1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.254036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1153/2288] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:19 2022] DELETE /identity/v3/users/b3e0f5983b0e448297979cb002ab37c1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:19.255472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:19.256821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:19.335485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1136/2289] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:19.345409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:19.348037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:19.354898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:19.423135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c08417-bce9-4cf4-9d89-0d65e7d76996 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:19.426947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b744c-dcf8-4fa2-9da8-bce900dc3017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:19.427630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b744c-dcf8-4fa2-9da8-bce900dc3017 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:19.427916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b744c-dcf8-4fa2-9da8-bce900dc3017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:19.428198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b744c-dcf8-4fa2-9da8-bce900dc3017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:19.438272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b744c-dcf8-4fa2-9da8-bce900dc3017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:19.440048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b744c-dcf8-4fa2-9da8-bce900dc3017 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:19.456303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1154/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:19.793290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:19.795323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:19.835867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a90ba-44d8-4bb2-b2bc-454e6f267697 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:19.846735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:19.847740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:19.848133 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:19.848464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] PATH_INFO: `/v3/projects/916b2696d2a348be85fd8c4a1cecd71c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:19.850625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916b2696d2a348be85fd8c4a1cecd71c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:19.854719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:19.921619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916b2696d2a348be85fd8c4a1cecd71c', 'request_id': 'req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.929746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:19.932334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916b2696d2a348be85fd8c4a1cecd71c', 'request_id': 'req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.941083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916b2696d2a348be85fd8c4a1cecd71c', 'request_id': 'req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.965315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] The token cache is being invalidate because project 916b2696d2a348be85fd8c4a1cecd71c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:19.965621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.966528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:19.968373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1137/2291] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:19 2022] DELETE /identity/v3/projects/916b2696d2a348be85fd8c4a1cecd71c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:19.977120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:19.978776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8257-2de7-4c48-83e3-e2ad0cd4b9a2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:19.979211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8257-2de7-4c48-83e3-e2ad0cd4b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:19.979888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8257-2de7-4c48-83e3-e2ad0cd4b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:19.980404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.008028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-88cc8257-2de7-4c48-83e3-e2ad0cd4b9a2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:20.009062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-88cc8257-2de7-4c48-83e3-e2ad0cd4b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.090712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bddd55-fa4e-4b45-ad82-f2fbaa7755b9 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.096511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.097394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.097683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.097963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] PATH_INFO: `/v3/projects/9de886d636ee47d0b59d8dae9df49c85` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.099535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de886d636ee47d0b59d8dae9df49c85)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.101804 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.119873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1155/2292] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:20.129065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.129357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.129865 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.152195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:20.154077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.163448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1156/2293] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:20.167919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.178800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518acdc7-b946-4353-8520-9fd13bb23f8d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.179685 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de886d636ee47d0b59d8dae9df49c85', 'request_id': 'req-72d5011e-1155-4af4-9385-d7d446f3d0ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.186162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de886d636ee47d0b59d8dae9df49c85', 'request_id': 'req-72d5011e-1155-4af4-9385-d7d446f3d0ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.193442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de886d636ee47d0b59d8dae9df49c85', 'request_id': 'req-72d5011e-1155-4af4-9385-d7d446f3d0ff'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.207358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] The token cache is being invalidate because project 9de886d636ee47d0b59d8dae9df49c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:20.207660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.208386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.210104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1138/2294] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:19 2022] DELETE /identity/v3/projects/9de886d636ee47d0b59d8dae9df49c85 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:20.214180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.215776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.242819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.243409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.243691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.243968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.244813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:20.245206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.247189 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.263877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1157/2295] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:11:20.264884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.266732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.279992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64915-e8b6-405c-91e8-c54da1417a76 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.284731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.285383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.285719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.285998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.286722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.288723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5011e-1155-4af4-9385-d7d446f3d0ff admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.289169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.293834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.294742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.295042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.295312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] PATH_INFO: `/v3/users/359cc1e54c7143b89f7646f2922b5228` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.296526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=359cc1e54c7143b89f7646f2922b5228)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.298492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.316362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:20.319067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1158/2296] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:20 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:20.323435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.339048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:20.355175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359cc1e54c7143b89f7646f2922b5228'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.364055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359cc1e54c7143b89f7646f2922b5228'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.364739 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359cc1e54c7143b89f7646f2922b5228'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.365372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359cc1e54c7143b89f7646f2922b5228'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.380723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359cc1e54c7143b89f7646f2922b5228'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:20.392249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b5999-a02f-49fe-bf4b-8c5c632b6dab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.395652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1139/2297] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:20 2022] DELETE /identity/v3/users/359cc1e54c7143b89f7646f2922b5228 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:20.397124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.397791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.398076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.398382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.399431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.400978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.423295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1159/2298] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:20 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:20.427950 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.429611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.509722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4943d7-cbff-4c27-a3da-a89611f8c93b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.515484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.516772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.516772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.516970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.517755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.519582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.530891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1140/2299] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:20.535204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.547308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068be8d-44c9-490b-a7fc-4c5282f0ef21 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.554577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35562-6ca6-4b35-a776-09583921c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.555250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35562-6ca6-4b35-a776-09583921c915 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.555538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35562-6ca6-4b35-a776-09583921c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.555845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35562-6ca6-4b35-a776-09583921c915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.556586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b35562-6ca6-4b35-a776-09583921c915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.558215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b35562-6ca6-4b35-a776-09583921c915 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.569041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1160/2300] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:20.573533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.587807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162859ef-775d-4892-b03c-8316d31ded9d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:20.594153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:20.595172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.595352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.596619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] PATH_INFO: `/v3/projects/aea76933c8cf47e08c83e52d206ee6a0/users/bf9c5bb4e77d4eaab8627fecf8df53d2/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.615928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea76933c8cf47e08c83e52d206ee6a0, user_id=bf9c5bb4e77d4eaab8627fecf8df53d2, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:20.618653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:20.636735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1141/2301] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:20 2022] PUT /identity/v3/projects/aea76933c8cf47e08c83e52d206ee6a0/users/bf9c5bb4e77d4eaab8627fecf8df53d2/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:20.649317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:20.649598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:20.649874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:20.682183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] MFA Rules not processed for user `bf9c5bb4e77d4eaab8627fecf8df53d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:20.683552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.795856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.798153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:20.885370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1161/2302] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:20.961332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:20.963129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.007367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58bccf-d372-4692-9648-44f5de4b08f1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.017199 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.022300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.022300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.022300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] PATH_INFO: `/v3/projects/421cf32787704a999791126b9a11ab6d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.023826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421cf32787704a999791126b9a11ab6d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.027334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.038067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:21.092639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45862a-8133-44a9-a5e7-398937c6e951 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.109037 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421cf32787704a999791126b9a11ab6d', 'request_id': 'req-b35c290e-923d-444e-8489-2338472b9de4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.118029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421cf32787704a999791126b9a11ab6d', 'request_id': 'req-b35c290e-923d-444e-8489-2338472b9de4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.127117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421cf32787704a999791126b9a11ab6d', 'request_id': 'req-b35c290e-923d-444e-8489-2338472b9de4'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.144954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:21.147394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] The token cache is being invalidate because project 421cf32787704a999791126b9a11ab6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:21.147840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.148946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35c290e-923d-444e-8489-2338472b9de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.151395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1142/2303] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:20 2022] DELETE /identity/v3/projects/421cf32787704a999791126b9a11ab6d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:21.157137 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755bab0-6af2-4d57-9b01-4075992fffed None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.157824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755bab0-6af2-4d57-9b01-4075992fffed None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.157987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755bab0-6af2-4d57-9b01-4075992fffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.177000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.178263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.178730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.179473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.180873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1755bab0-6af2-4d57-9b01-4075992fffed None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:21.182903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1755bab0-6af2-4d57-9b01-4075992fffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.184201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.264870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1143/2304] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:21.273906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.274441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.274441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.280458 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.282636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.293731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1162/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:11:21.300498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:21.302250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.315670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.317526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.322657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1144/2306] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:21.324045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.333656 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918495b2-1e6b-4851-8c19-3ee064629dbc service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.337288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18eb96-529b-4e9c-9328-f6947f4f2d34 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.342512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.343763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.344048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.344364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] PATH_INFO: `/v3/users/bf9c5bb4e77d4eaab8627fecf8df53d2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.346723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.347466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.347748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.347864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9c5bb4e77d4eaab8627fecf8df53d2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.348034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.348819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:21.349136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.349955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.351005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.403973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1145/2307] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:21.405507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.424817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59323c04-dfc0-4e5a-bc32-7e6e48728517 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.427358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.428150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.428902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.428902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.430307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.432375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.458506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9c5bb4e77d4eaab8627fecf8df53d2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.466439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9c5bb4e77d4eaab8627fecf8df53d2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.467191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9c5bb4e77d4eaab8627fecf8df53d2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.475589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1146/2308] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:21 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:21.483041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9c5bb4e77d4eaab8627fecf8df53d2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.484382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d02b0c5d-326e-4fbd-8a1d-b37c0530598f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9c5bb4e77d4eaab8627fecf8df53d2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:21.485582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.489043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.539385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1163/2309] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:21 2022] DELETE /identity/v3/users/bf9c5bb4e77d4eaab8627fecf8df53d2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:21.544205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.544634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.544767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.584369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:21.587085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.638780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:21.657676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b138aec-b920-4400-9e2d-7d89f6d6f6c7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.676240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1164/2310] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:21.688937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.693952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:21.709476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:21.754335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.755320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.755666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.755952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.760424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.760424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.789468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1147/2311] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:21 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:21.798548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.814597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96066adf-75e4-41ff-bd31-2cddcb89d29f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.818601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.819265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.819635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.819741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a79c-3894-47ea-a257-2fa0495b4c62 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.819952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.834835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.835170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.835857 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.835966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.836266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.837214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.838748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.842006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.860840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1148/2312] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:21.863042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1165/2313] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:21.867504 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.891652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf852b2-79e3-4cbb-9b25-326fc2d3a396 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.907595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a202feb-210c-49e7-9dea-ff728d538cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.909241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a202feb-210c-49e7-9dea-ff728d538cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.909531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a202feb-210c-49e7-9dea-ff728d538cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.909809 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a202feb-210c-49e7-9dea-ff728d538cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:21.912241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a202feb-210c-49e7-9dea-ff728d538cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:21.918904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a202feb-210c-49e7-9dea-ff728d538cf9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:21.952688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1166/2314] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:21.956558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:21.969684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb51cc3-173f-47cf-b334-57e8a9a70b80 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:21.984700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:21.985608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:21.985898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:21.986252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] PATH_INFO: `/v3/projects/db998d5e70744169a27846e92c53508b/users/f3d196253b5843dcb00779fb680a1c42/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.023844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db998d5e70744169a27846e92c53508b, user_id=f3d196253b5843dcb00779fb680a1c42, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.026955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:22.059684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1149/2315] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:21 2022] PUT /identity/v3/projects/db998d5e70744169a27846e92c53508b/users/f3d196253b5843dcb00779fb680a1c42/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:22.074707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.075035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.075284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.133011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] MFA Rules not processed for user `f3d196253b5843dcb00779fb680a1c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:22.134083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:22.238036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1167/2316] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:22.241737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:22.331376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5680d-ac1f-4702-aa40-d716fb3a9487 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:22.338036 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:22.339099 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.339463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.339852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.340990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.344454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:22.388595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:22.391604 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1150/2317] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:22 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:22.401708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4990d32-9461-4135-88b4-6d0d483bced4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:22.503562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:22.504254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.504535 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.504867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.507177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.508822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:22.562661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:22.586367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1168/2318] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:22 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:22.590121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69ddea-33c0-43fc-b800-9048682e8996 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:22.598821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:22.599629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.600365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.600692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.601444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.603290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:22.626173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:22.633243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1151/2319] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:22.640578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91ad6-a5ad-4cdc-84e9-6154624027dc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:22.657390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:22.659771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.660456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.661076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.661633 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.665190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:22.680465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1169/2320] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:22.684909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:22.697876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117a4ad-184e-4aea-a058-f12f6b3ba2f3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:22.706811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819803b2-9ecc-44d0-9e66-e7462d52055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:22.707945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819803b2-9ecc-44d0-9e66-e7462d52055f admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.708175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819803b2-9ecc-44d0-9e66-e7462d52055f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.708461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819803b2-9ecc-44d0-9e66-e7462d52055f admin admin] PATH_INFO: `/v3/projects/3550189799624304981c378f264b5897/users/27ec5572bbe2410391df74b49130a3c2/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.731531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819803b2-9ecc-44d0-9e66-e7462d52055f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3550189799624304981c378f264b5897, user_id=27ec5572bbe2410391df74b49130a3c2, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.736606 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819803b2-9ecc-44d0-9e66-e7462d52055f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:22.770002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:22.770524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1152/2321] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:22 2022] PUT /identity/v3/projects/3550189799624304981c378f264b5897/users/27ec5572bbe2410391df74b49130a3c2/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:22.771906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:22.772534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.773130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.773617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.781736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:22.789053 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:22.799325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f580b12-571c-43dc-a534-27df997aa1ae admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:22.829284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] MFA Rules not processed for user `27ec5572bbe2410391df74b49130a3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:22.832085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:22.926506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:22.927758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:22.928221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:22.928703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] PATH_INFO: `/v3/projects/aea76933c8cf47e08c83e52d206ee6a0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:22.930216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea76933c8cf47e08c83e52d206ee6a0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:22.933373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.017093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea76933c8cf47e08c83e52d206ee6a0', 'request_id': 'req-03b3a1b1-9c53-4696-bc45-2126be63a2e6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:23.028982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea76933c8cf47e08c83e52d206ee6a0', 'request_id': 'req-03b3a1b1-9c53-4696-bc45-2126be63a2e6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:23.038097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea76933c8cf47e08c83e52d206ee6a0', 'request_id': 'req-03b3a1b1-9c53-4696-bc45-2126be63a2e6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:23.049448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1153/2322] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:23.067433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.070744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] The token cache is being invalidate because project aea76933c8cf47e08c83e52d206ee6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:23.071046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:23.072751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-03b3a1b1-9c53-4696-bc45-2126be63a2e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:23.076563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1170/2323] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:22 2022] DELETE /identity/v3/projects/aea76933c8cf47e08c83e52d206ee6a0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:23.096480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594f09-f97b-4faf-a695-0dedb0ebf4b7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.097085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594f09-f97b-4faf-a695-0dedb0ebf4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.097441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594f09-f97b-4faf-a695-0dedb0ebf4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.106452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14124cd-c389-4d13-b535-89768f53b25f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.152525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f0594f09-f97b-4faf-a695-0dedb0ebf4b7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:23.153768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f0594f09-f97b-4faf-a695-0dedb0ebf4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:23.279681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1171/2324] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:23.288779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762826cd-bf34-49b1-a930-b1100306edec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.290407 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762826cd-bf34-49b1-a930-b1100306edec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.291985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762826cd-bf34-49b1-a930-b1100306edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.310410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.311102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.311777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.312065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.312777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.316147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.349578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-762826cd-bf34-49b1-a930-b1100306edec None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:23.355601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-762826cd-bf34-49b1-a930-b1100306edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:23.368310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1154/2325] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:23 2022] POST /identity/v3/projects => generated 383 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:23.370071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.375880 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:23.383777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1172/2326] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:23.385846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762826cd-bf34-49b1-a930-b1100306edec None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.413500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762826cd-bf34-49b1-a930-b1100306edec None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.481303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:23.550630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.551305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.551707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.551981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.552675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:23.552840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f82c14-be2d-4882-b8e3-dfffa5bdea86 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.553016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.555592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.586039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1173/2327] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:23.591603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.592565 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.600426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.600986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.603350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.606658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.611961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.616624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1208f3-bdf7-4bd1-9717-fd17b9428310 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.634301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.635103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.636261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.637667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.638654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.643637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.690574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1155/2328] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:23 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:23.703650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.724043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f88965-f34b-4fe1-ac03-bffd54e74a05 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.738265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.738265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.738265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.738265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.738733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.739267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.742552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:23.742705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1174/2329] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:23 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:23.747949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.759831 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1156/2330] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:23.761749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.778501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f616d16-934c-4b8a-9507-be8dd480cf59 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.872630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d1d84-17b1-446b-89c2-7251f795f3ff admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.881647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.882695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.883126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.883525 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.884750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.887763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.913549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.914793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.915185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.915417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] PATH_INFO: `/v3/projects/1be587ef62244ea3b8eeeb26f84dfec6/users/784c9193f3dc4cbb9182a99ff55f5c81/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.927020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1175/2331] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:23 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:23.931771 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.948087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e396a-2d09-4371-a161-93bb54f55588 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:23.948401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be587ef62244ea3b8eeeb26f84dfec6, user_id=784c9193f3dc4cbb9182a99ff55f5c81, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.952026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.954288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:23.955835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:23.956889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:23.957178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:23.958717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:23.960852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:23.982281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1176/2332] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:23.983775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.984558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1157/2333] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:23 2022] PUT /identity/v3/projects/1be587ef62244ea3b8eeeb26f84dfec6/users/784c9193f3dc4cbb9182a99ff55f5c81/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:23.990297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:23.996152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7878f4-8481-462a-b58b-5f48ca0beb07 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.102959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f08bc0-bb8b-4d47-879f-942f6f892b50 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.108666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.110146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.110736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.111579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.111938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.112274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.112560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.112902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.113608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.114409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.114764 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.116242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.134487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1158/2334] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:24.137094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:24.140658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1177/2335] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:24.141880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:24.156844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051828ee-b470-4a54-a8e6-0d97851a448c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.163533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59013fc-a6bd-4534-82ab-4f1b09266369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.164939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59013fc-a6bd-4534-82ab-4f1b09266369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.166564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59013fc-a6bd-4534-82ab-4f1b09266369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.167510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59013fc-a6bd-4534-82ab-4f1b09266369 admin admin] PATH_INFO: `/v3/projects/1be587ef62244ea3b8eeeb26f84dfec6/users/784c9193f3dc4cbb9182a99ff55f5c81/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.168696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5575bb-c3b8-4704-8300-4b1d5105c7c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.173430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59013fc-a6bd-4534-82ab-4f1b09266369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be587ef62244ea3b8eeeb26f84dfec6, user_id=784c9193f3dc4cbb9182a99ff55f5c81, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.178925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c5418-15fb-4b48-a2da-de72ebe392ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.180321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5418-15fb-4b48-a2da-de72ebe392ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.180434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59013fc-a6bd-4534-82ab-4f1b09266369 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.180715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5418-15fb-4b48-a2da-de72ebe392ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.181063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c5418-15fb-4b48-a2da-de72ebe392ad admin admin] PATH_INFO: `/v3/projects/04d7890f978547609e3866f85d1378d9/users/e7c7ddcdbbbd4cbdb5a6399bf3506198/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.200001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1159/2336] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:24 2022] PUT /identity/v3/projects/1be587ef62244ea3b8eeeb26f84dfec6/users/784c9193f3dc4cbb9182a99ff55f5c81/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:24.204585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.205196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.206884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.227086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:24.241253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c5418-15fb-4b48-a2da-de72ebe392ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d7890f978547609e3866f85d1378d9, user_id=e7c7ddcdbbbd4cbdb5a6399bf3506198, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.250672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c5418-15fb-4b48-a2da-de72ebe392ad admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.284613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1178/2337] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:24 2022] PUT /identity/v3/projects/04d7890f978547609e3866f85d1378d9/users/e7c7ddcdbbbd4cbdb5a6399bf3506198/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:24.297924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] MFA Rules not processed for user `784c9193f3dc4cbb9182a99ff55f5c81`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:24.299310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.299718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.299848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:24.300207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.359022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] MFA Rules not processed for user `e7c7ddcdbbbd4cbdb5a6399bf3506198`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:24.362135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:24.436946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:24.466250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1179/2338] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:24.478784 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1160/2339] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:24.479363 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:24.483087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:24.565505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:24.567664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:24.572859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93008444-fecf-4ddf-8c13-d8d348739042 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.576857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.577886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.577886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.578159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.588389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.589628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.589758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf98e9-d16f-467f-bcee-2dfa26398fa0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.599686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.600667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.601069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.601193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1180/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:24.601306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.603168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:24.627639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:24.717601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a2d7f-7b70-451e-8d40-bee516eaaae6 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:24.723166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:24.724193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.724478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.724748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] PATH_INFO: `/v3/users/e7c7ddcdbbbd4cbdb5a6399bf3506198` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.725966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c7ddcdbbbd4cbdb5a6399bf3506198)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.727904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.729988 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:24.732627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1c37d-3a06-427d-8487-23885532c6d8 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:24.762258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1161/2341] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:24.796924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:24.855575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c7ddcdbbbd4cbdb5a6399bf3506198'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:24.867455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c7ddcdbbbd4cbdb5a6399bf3506198'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:24.868604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c7ddcdbbbd4cbdb5a6399bf3506198'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:24.881719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c7ddcdbbbd4cbdb5a6399bf3506198'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:24.884683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c7ddcdbbbd4cbdb5a6399bf3506198'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:24.921964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1181/2342] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:24 2022] DELETE /identity/v3/users/e7c7ddcdbbbd4cbdb5a6399bf3506198 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:24.926569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:24.926990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:24.927365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:24.951176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:24.953237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:24.971970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:24.973979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.083052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0a942-3122-4498-8a66-e5f511ae7dee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:25.087979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:25.088380 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:25.088667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:25.088938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:25.091736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.119889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1162/2343] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:25.132487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:25.134652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.212294 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:25.213538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:25.225035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1182/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:25.232156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:25.235670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.258006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bafbc7-a948-4a12-929f-dc20137cb2c8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:25.265892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4ed7d-1d62-4e1c-a7ea-bc6ade7ae486 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:25.276698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03511-1636-4665-83c1-4f3262e9ef5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:25.277632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03511-1636-4665-83c1-4f3262e9ef5e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:25.278378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:25.278983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03511-1636-4665-83c1-4f3262e9ef5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:25.279989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03511-1636-4665-83c1-4f3262e9ef5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:25.282286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:25.282580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:25.282891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] PATH_INFO: `/v3/users/cd46670078334b8db10e7d1710e967a0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:25.286061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd46670078334b8db10e7d1710e967a0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:25.288017 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:25.306821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b03511-1636-4665-83c1-4f3262e9ef5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:25.308487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b03511-1636-4665-83c1-4f3262e9ef5e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:25.328584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1163/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:25.397297 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd46670078334b8db10e7d1710e967a0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.399246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:25.419242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd46670078334b8db10e7d1710e967a0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.421061 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd46670078334b8db10e7d1710e967a0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.447658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd46670078334b8db10e7d1710e967a0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.450354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd46670078334b8db10e7d1710e967a0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.475914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1183/2346] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:25 2022] DELETE /identity/v3/users/cd46670078334b8db10e7d1710e967a0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:25.480250 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:25.480740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:25.480827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:25.515506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:25.516758 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.563060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:25.600900 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1164/2347] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:25.612597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:25.614360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.681007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131d59-527c-451b-b5e6-5a0b5d62f977 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:25.685049 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:25.685729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:25.686010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:25.686323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:25.697401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:25.699157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:25.702402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:25.704299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:25.711713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1184/2348] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:25.720936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d4bb-5f4e-4c2e-82c4-81bff246b062 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:25.726767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:25.727658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:25.727939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:25.728206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] PATH_INFO: `/v3/projects/04d7890f978547609e3866f85d1378d9` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:25.729428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d7890f978547609e3866f85d1378d9)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:25.731378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:25.794410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d7890f978547609e3866f85d1378d9', 'request_id': 'req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.806306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d7890f978547609e3866f85d1378d9', 'request_id': 'req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.813573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d7890f978547609e3866f85d1378d9', 'request_id': 'req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.831493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] The token cache is being invalidate because project 04d7890f978547609e3866f85d1378d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:25.831865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.832652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-46ac4329-fcff-4579-ae20-5f2b4f75e0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:25.834463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1165/2349] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:25 2022] DELETE /identity/v3/projects/04d7890f978547609e3866f85d1378d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:26.115379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.117320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:26.136224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9c2e-185c-4c45-97b6-fc3899eadb11 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.287836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.288723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.289007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.290158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] PATH_INFO: `/v3/projects/eab1752433084f36948a78d3d410e191` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.291493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab1752433084f36948a78d3d410e191)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.293765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.366527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab1752433084f36948a78d3d410e191', 'request_id': 'req-43dbbe5e-f994-49df-a93a-68d1320b8eca'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:26.377429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab1752433084f36948a78d3d410e191', 'request_id': 'req-43dbbe5e-f994-49df-a93a-68d1320b8eca'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:26.387239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab1752433084f36948a78d3d410e191', 'request_id': 'req-43dbbe5e-f994-49df-a93a-68d1320b8eca'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:26.399864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:26.408834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] The token cache is being invalidate because project eab1752433084f36948a78d3d410e191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:26.409039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:26.409790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43dbbe5e-f994-49df-a93a-68d1320b8eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:26.411777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1185/2350] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:26 2022] DELETE /identity/v3/projects/eab1752433084f36948a78d3d410e191 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:26.417843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.420115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.420633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.443208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:26.444668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:26.535006 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1166/2351] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:26.547067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.547067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.547067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.583991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:26.585485 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:26.601346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1186/2352] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:26.605681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.618581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ccb75-5372-45ab-aff5-95cadee0e5b2 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.625990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.626846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.628005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.628406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:26.628511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.628722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.629534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:26.629967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.631652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.650274 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1167/2353] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:26.654400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.666249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac6c3-b15c-425a-b51d-da54900b9a7e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.671255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.672052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.672442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.672820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.675051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.676495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.703659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fc9e2-db2f-4598-81f7-771cc2b45dd9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.704499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1168/2354] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:26 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:26.708545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.732552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:26.756433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.757169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.757605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.757988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.759817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:26.777313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567f8a-5c0c-47da-b1cb-c6bd62ae0f07 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.782097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.783341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.783632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.783935 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.784621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.786561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.806638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1169/2355] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:26 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:11:26.811110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.822538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beff9f-8394-44e2-8906-d67bb7454cdd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.827836 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.828319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.828983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.829268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.829362 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.829545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.830421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.832059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.840727 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1187/2356] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:11:26.844075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1170/2357] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:26.849303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.864544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a4dc-c250-4a34-ae3a-1ad1ffce4a55 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.870623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fe916-10a9-49c8-ab9b-13e14e6d19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.871148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe916-10a9-49c8-ab9b-13e14e6d19d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.872427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe916-10a9-49c8-ab9b-13e14e6d19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.872697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe916-10a9-49c8-ab9b-13e14e6d19d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.873621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fe916-10a9-49c8-ab9b-13e14e6d19d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.876069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fe916-10a9-49c8-ab9b-13e14e6d19d8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.888875 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1188/2358] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:26.893834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:26.905271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51ed84-b725-4155-baaa-8aa9bdfac857 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:26.911326 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:26.912287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.912639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.912993 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] PATH_INFO: `/v3/projects/fe6bf9de9cf34ea6b52532e7e57c5d83/users/c9a815e098b14241b01ecc2ef4e8a675/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.928485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6bf9de9cf34ea6b52532e7e57c5d83, user_id=c9a815e098b14241b01ecc2ef4e8a675, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:26.931552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:26.947525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1171/2359] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:26 2022] PUT /identity/v3/projects/fe6bf9de9cf34ea6b52532e7e57c5d83/users/c9a815e098b14241b01ecc2ef4e8a675/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:26.960452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:26.961063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:26.961063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:26.994942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] MFA Rules not processed for user `c9a815e098b14241b01ecc2ef4e8a675`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:26.996464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:27.044186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:27.073445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1189/2360] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:27.085829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:27.087540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:27.149161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f73ff-84ef-47c2-b5e3-f8b41809880c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:27.152888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:27.153540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:27.153824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:27.154102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:27.163575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:27.165234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:27.175878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1172/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:27.435052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:27.449827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8254b2-ed80-4bc9-83e2-6aa8d3a74b6d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:27.461293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:27.462123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:27.463034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:27.463034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:27.465100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:27.587144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:27.588691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5509a3-7b08-47a8-8737-af5ab4654644 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:27.601018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1190/2362] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:29.131524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:29.134312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:29.251252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259559ec-ec64-43b7-9d1a-d13d2d879c9e service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:29.266686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:29.266686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:29.266686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:29.266686 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] PATH_INFO: `/v3/users/b96f9992385d4661ba4de3a9a8ac3c74` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:29.267553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96f9992385d4661ba4de3a9a8ac3c74)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:29.269492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:29.293842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:29.321228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96f9992385d4661ba4de3a9a8ac3c74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.328415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96f9992385d4661ba4de3a9a8ac3c74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.329096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96f9992385d4661ba4de3a9a8ac3c74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.329735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96f9992385d4661ba4de3a9a8ac3c74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.342242 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96f9992385d4661ba4de3a9a8ac3c74'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.355488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1173/2363] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:29 2022] DELETE /identity/v3/users/b96f9992385d4661ba4de3a9a8ac3c74 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:29.360021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:29.361361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:29.361659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:29.382314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:29.382830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:29.441678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1191/2364] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:29.451297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:29.452894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:29.512519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b831-b18e-438c-9b6f-2fd92781c972 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:29.516210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c16885-c5d2-478b-a9b5-fa35c5d003c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:29.516855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16885-c5d2-478b-a9b5-fa35c5d003c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:29.517221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16885-c5d2-478b-a9b5-fa35c5d003c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:29.517994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c16885-c5d2-478b-a9b5-fa35c5d003c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:29.527061 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c16885-c5d2-478b-a9b5-fa35c5d003c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:29.528478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c16885-c5d2-478b-a9b5-fa35c5d003c5 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:29.538350 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1174/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:29.804087 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:29.805464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:29.817673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccb1e4-2f4e-41d8-9c1e-e0591839c724 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:29.834630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:29.835538 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:29.835821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:29.836094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] PATH_INFO: `/v3/projects/77e6d2ce77e0434c98a2104e76cf0202` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:29.840583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e6d2ce77e0434c98a2104e76cf0202)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:29.843295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:29.894905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e6d2ce77e0434c98a2104e76cf0202', 'request_id': 'req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.900242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e6d2ce77e0434c98a2104e76cf0202', 'request_id': 'req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.906283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e6d2ce77e0434c98a2104e76cf0202', 'request_id': 'req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.915367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:29.921452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] The token cache is being invalidate because project 77e6d2ce77e0434c98a2104e76cf0202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:29.922400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.924345 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b6e1772-38bd-49d9-bc9c-925b60ed73e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:29.926429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1192/2366] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:29 2022] DELETE /identity/v3/projects/77e6d2ce77e0434c98a2104e76cf0202 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:29.931082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:29.931456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:29.931750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:29.949591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:29.950813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:30.011381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1175/2367] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:30.019320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.019610 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.019915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.038718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:30.039897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:30.047714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1193/2368] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:30.052458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.062069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb38ebb-94d8-4a62-925c-3faab73b7a17 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.067206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.067852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.068134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.068407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.069469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:30.069775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.071408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.083674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1176/2369] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:30.088820 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.101040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908446f-761b-4314-a6bf-d6c40029ffc8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.111862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.112618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.112968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.113311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.114125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.116270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.143732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1194/2370] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:30 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:30.147898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.158719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eca64-2977-4a7e-bc58-8736a23c150e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.184635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:30.230597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.231382 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.231775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.232059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.233233 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.235628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.273957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1177/2371] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:30 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:11:30.277404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.294968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1da45-bd76-43b1-83c7-6a75b94577a7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.314615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.314615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.314615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.314615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.314907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.315697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.338616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1195/2372] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:30.343508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.361140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cef78-5e3b-4395-abb7-6589bea95473 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.369359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b82b77-5ab2-454f-a9cf-ae29e3114688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.371688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82b77-5ab2-454f-a9cf-ae29e3114688 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.372193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82b77-5ab2-454f-a9cf-ae29e3114688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.372687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82b77-5ab2-454f-a9cf-ae29e3114688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.373626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82b77-5ab2-454f-a9cf-ae29e3114688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.377261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82b77-5ab2-454f-a9cf-ae29e3114688 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.397462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1178/2373] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:30.399102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.411011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3a8ed-f371-46cb-99e6-66393aa0a7f6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.417546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.419389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.419883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.420650 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] PATH_INFO: `/v3/projects/c1eea6bc4e674e6daeca785054dbf7e1/users/6408341a3c1b40d192941e20356ee0e1/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.466005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1eea6bc4e674e6daeca785054dbf7e1, user_id=6408341a3c1b40d192941e20356ee0e1, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.470022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.496289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1196/2374] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:30 2022] PUT /identity/v3/projects/c1eea6bc4e674e6daeca785054dbf7e1/users/6408341a3c1b40d192941e20356ee0e1/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:30.509484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.510355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.510656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.544121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] MFA Rules not processed for user `6408341a3c1b40d192941e20356ee0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:30.545705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:30.679171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1179/2375] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:30.703654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:30.705637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:30.788607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf57fd-6cef-4b55-b917-6cb13303883a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:30.792598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fab1eb-b820-457a-8a7e-61e1d09ad889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:30.793287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fab1eb-b820-457a-8a7e-61e1d09ad889 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:30.793559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fab1eb-b820-457a-8a7e-61e1d09ad889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:30.793799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fab1eb-b820-457a-8a7e-61e1d09ad889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:30.804062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fab1eb-b820-457a-8a7e-61e1d09ad889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:30.805555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fab1eb-b820-457a-8a7e-61e1d09ad889 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:30.839891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1197/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:32.086937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:32.088629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:32.190520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e53ce-8047-4bfe-9710-1e4869cc089c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:32.211767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:32.212663 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:32.212942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:32.213210 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] PATH_INFO: `/v3/users/f3d196253b5843dcb00779fb680a1c42` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:32.214661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d196253b5843dcb00779fb680a1c42)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:32.216931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:32.262498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:32.279730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d196253b5843dcb00779fb680a1c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:32.283007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d196253b5843dcb00779fb680a1c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:32.284369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d196253b5843dcb00779fb680a1c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:32.285138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d196253b5843dcb00779fb680a1c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:32.299579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d196253b5843dcb00779fb680a1c42'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:32.318675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1180/2377] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:32 2022] DELETE /identity/v3/users/f3d196253b5843dcb00779fb680a1c42 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:32.323304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:32.323740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:32.324044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:32.340957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:32.342154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:32.423111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1198/2378] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:32.432109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:32.433806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:32.505469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e97d19-fe42-425e-86d3-a1c274c42921 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:32.509455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:32.510038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:32.510352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:32.510636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:32.524461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:32.526568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:32.540058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1181/2379] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:32.888174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:32.889830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:32.943161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd20aa-19f3-4177-aa13-f62b8c0bc401 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:32.948989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:32.949963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:32.950381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:32.950834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] PATH_INFO: `/v3/projects/db998d5e70744169a27846e92c53508b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:32.952326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db998d5e70744169a27846e92c53508b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:32.954430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:33.003427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:33.034681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db998d5e70744169a27846e92c53508b', 'request_id': 'req-f9a0195f-7bed-4b99-b699-ee89edc401f6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.045059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db998d5e70744169a27846e92c53508b', 'request_id': 'req-f9a0195f-7bed-4b99-b699-ee89edc401f6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.055343 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db998d5e70744169a27846e92c53508b', 'request_id': 'req-f9a0195f-7bed-4b99-b699-ee89edc401f6'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.074071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] The token cache is being invalidate because project db998d5e70744169a27846e92c53508b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:33.074540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.075258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.077377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1199/2380] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:32 2022] DELETE /identity/v3/projects/db998d5e70744169a27846e92c53508b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:33.081872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:33.096245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386bb2a-6387-4e2c-a00b-272e3ede7a63 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:33.202112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:33.214683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:33.215027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:33.215322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] PATH_INFO: `/v3/users/27ec5572bbe2410391df74b49130a3c2` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:33.219732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ec5572bbe2410391df74b49130a3c2)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:33.222291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:33.301336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ec5572bbe2410391df74b49130a3c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.309495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ec5572bbe2410391df74b49130a3c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.310193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ec5572bbe2410391df74b49130a3c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.310830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ec5572bbe2410391df74b49130a3c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.314445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:33.337895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ec5572bbe2410391df74b49130a3c2'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:33.362208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1182/2381] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:33 2022] DELETE /identity/v3/users/27ec5572bbe2410391df74b49130a3c2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:33.805241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:33.806896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:33.841747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0195f-7bed-4b99-b699-ee89edc401f6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:33.955606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:33.956863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:33.957362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:33.957858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] PATH_INFO: `/v3/projects/3550189799624304981c378f264b5897` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:33.959713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3550189799624304981c378f264b5897)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:33.962591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:34.060936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3550189799624304981c378f264b5897', 'request_id': 'req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.070166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3550189799624304981c378f264b5897', 'request_id': 'req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.096487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3550189799624304981c378f264b5897', 'request_id': 'req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.119081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] The token cache is being invalidate because project 3550189799624304981c378f264b5897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:34.119701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.120499 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.122450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1200/2382] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:33 2022] DELETE /identity/v3/projects/3550189799624304981c378f264b5897 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:34.128288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:34.132339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:34.151511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ba690-f0e2-451d-8f6e-6fa7053ec480 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:34.216776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:34.222603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:34.223076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:34.223531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] PATH_INFO: `/v3/users/784c9193f3dc4cbb9182a99ff55f5c81` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:34.225143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=784c9193f3dc4cbb9182a99ff55f5c81)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:34.227272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:34.311072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784c9193f3dc4cbb9182a99ff55f5c81'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.317917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784c9193f3dc4cbb9182a99ff55f5c81'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.318653 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784c9193f3dc4cbb9182a99ff55f5c81'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.319352 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784c9193f3dc4cbb9182a99ff55f5c81'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.340806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6ffc8c97-08cc-4916-9312-25cb9c1940dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784c9193f3dc4cbb9182a99ff55f5c81'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.365371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1183/2383] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:34 2022] DELETE /identity/v3/users/784c9193f3dc4cbb9182a99ff55f5c81 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:34.735308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:34.737942 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:34.761744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd925a-4a8c-4986-815e-8cd8dbbaba71 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:34.871818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:34.900295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:34.901202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:34.901487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:34.901759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] PATH_INFO: `/v3/projects/1be587ef62244ea3b8eeeb26f84dfec6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:34.903344 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be587ef62244ea3b8eeeb26f84dfec6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:34.905324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:34.976719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be587ef62244ea3b8eeeb26f84dfec6', 'request_id': 'req-148e5043-be36-45f0-9357-d83fcde3ce91'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:34.992699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be587ef62244ea3b8eeeb26f84dfec6', 'request_id': 'req-148e5043-be36-45f0-9357-d83fcde3ce91'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:35.004173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be587ef62244ea3b8eeeb26f84dfec6', 'request_id': 'req-148e5043-be36-45f0-9357-d83fcde3ce91'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:35.024915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] The token cache is being invalidate because project 1be587ef62244ea3b8eeeb26f84dfec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:35.025259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:35.025947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-148e5043-be36-45f0-9357-d83fcde3ce91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:35.029618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1201/2384] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:34 2022] DELETE /identity/v3/projects/1be587ef62244ea3b8eeeb26f84dfec6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:35.035931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.036389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.036824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.056649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:35.058386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:35.117176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:35.136829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1184/2385] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:35.146156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.147925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.147925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.173964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:35.175523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:35.199228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.200793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1202/2386] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:35.217630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e8e66-6624-40cc-ad3a-79abc55eeb08 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.217630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.217630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.217630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.217987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.217987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:35.217987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.219215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.235830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1185/2387] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:35.236392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.247641 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083d318-4313-4385-a07f-04e95dd6e512 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.253457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.254129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.254486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.254770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.255469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.259680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.313364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1203/2388] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:35 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:35.316557 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.331329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129875e6-efd2-4260-9f7e-557c9b12dc7b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.443318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.444411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.445432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.445856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.446787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.449237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.476504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1186/2389] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:35 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:35.480186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.492574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e35a4-e6fe-4e8d-909b-b0e2ea8ebfa9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.498409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.499378 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.500174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.501886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.502867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.504798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.523739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1204/2390] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:35.524717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.542978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423dc4ab-d41a-4a78-a7c0-504e2957e969 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.550080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20437d2-f782-4fcb-9364-35edf5b01f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.551041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20437d2-f782-4fcb-9364-35edf5b01f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.551523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20437d2-f782-4fcb-9364-35edf5b01f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.551967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20437d2-f782-4fcb-9364-35edf5b01f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.553106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20437d2-f782-4fcb-9364-35edf5b01f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.555295 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20437d2-f782-4fcb-9364-35edf5b01f15 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.577171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.587012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1187/2391] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:35.592577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2a52-2102-4a4e-8367-f12c80de573a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.599379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.601333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.601905 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.602352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] PATH_INFO: `/v3/projects/ea167a2434aa49998639bf956c826d88/users/79b787db677d4179bca32d9859e2972e/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.641768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea167a2434aa49998639bf956c826d88, user_id=79b787db677d4179bca32d9859e2972e, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.645360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.682321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1205/2392] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:35 2022] PUT /identity/v3/projects/ea167a2434aa49998639bf956c826d88/users/79b787db677d4179bca32d9859e2972e/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:35.687110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.687405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.687689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.727020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] MFA Rules not processed for user `79b787db677d4179bca32d9859e2972e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:35.728332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:35.817561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1188/2393] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:35.834211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:35.838124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:35.929723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507a5b-9a04-4f39-a511-8bf4ce6c49ac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:35.939444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d567a-6b6d-49c8-b283-52068f136197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:35.940124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d567a-6b6d-49c8-b283-52068f136197 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:35.940410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d567a-6b6d-49c8-b283-52068f136197 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:35.940684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d567a-6b6d-49c8-b283-52068f136197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:35.962572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d567a-6b6d-49c8-b283-52068f136197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:35.964866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d567a-6b6d-49c8-b283-52068f136197 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:35.993336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1206/2394] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:36.399283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:36.401468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:36.463324 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:36.480218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68bb15-0e3a-46cd-be6f-effbb6c74bf1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:36.485298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:36.486839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:36.487192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:36.487535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] PATH_INFO: `/v3/users/6408341a3c1b40d192941e20356ee0e1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:36.489124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6408341a3c1b40d192941e20356ee0e1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:36.491420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:36.538670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6408341a3c1b40d192941e20356ee0e1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:36.545623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6408341a3c1b40d192941e20356ee0e1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:36.546327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6408341a3c1b40d192941e20356ee0e1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:36.546945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6408341a3c1b40d192941e20356ee0e1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:36.560415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6408341a3c1b40d192941e20356ee0e1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:36.575289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1189/2395] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:36 2022] DELETE /identity/v3/users/6408341a3c1b40d192941e20356ee0e1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:36.579990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:36.580281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:36.580564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:36.599108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:36.600334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:36.614786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:36.664296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1207/2396] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:36.674158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:36.675674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:36.735218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde87a79-e575-4a1c-8e09-ae0fbe9083cd admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:36.739052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e78-219a-409a-b9c2-cfdda371aeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:36.739701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e78-219a-409a-b9c2-cfdda371aeaa service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:36.739995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e78-219a-409a-b9c2-cfdda371aeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:36.740265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e78-219a-409a-b9c2-cfdda371aeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:36.749361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e78-219a-409a-b9c2-cfdda371aeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:36.751091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e78-219a-409a-b9c2-cfdda371aeaa service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:36.760832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1190/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:37.035539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.037071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:37.049073 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da99995-43c3-4352-b0ee-93278ce23b97 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.053708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.054665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.054975 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.055252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] PATH_INFO: `/v3/projects/c1eea6bc4e674e6daeca785054dbf7e1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.056496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1eea6bc4e674e6daeca785054dbf7e1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.058472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.107056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1eea6bc4e674e6daeca785054dbf7e1', 'request_id': 'req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:37.112323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1eea6bc4e674e6daeca785054dbf7e1', 'request_id': 'req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:37.118476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1eea6bc4e674e6daeca785054dbf7e1', 'request_id': 'req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:37.131231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] The token cache is being invalidate because project c1eea6bc4e674e6daeca785054dbf7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:37.131517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:37.132121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7a7852dd-0ffa-4d8f-b98d-ec4f459204fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:37.133683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1208/2398] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:37 2022] DELETE /identity/v3/projects/c1eea6bc4e674e6daeca785054dbf7e1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:37.139264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.139667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.139951 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.158023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:37.159252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:37.242848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1191/2399] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:37.245095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a606-b305-4130-9d4a-87545d364551 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.245489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a606-b305-4130-9d4a-87545d364551 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.245868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a606-b305-4130-9d4a-87545d364551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.266163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7893a606-b305-4130-9d4a-87545d364551 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:37.268177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7893a606-b305-4130-9d4a-87545d364551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:37.281314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1209/2400] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:37.282578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.302437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006acee6-7416-4dc3-8a5d-a2a8820dbe99 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.316068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.316068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.316068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.316336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.316941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:37.317253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.318897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.331794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:37.339227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1192/2401] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:37.344355 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a606-b305-4130-9d4a-87545d364551 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.355601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a606-b305-4130-9d4a-87545d364551 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.361375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.361980 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.362312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.362580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.363285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.365276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.410117 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1210/2402] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:37 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:37.411499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.425873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482caf0-8944-4ce9-b952-f214cd6316c5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.514637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.515577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.515848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.516128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.517118 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.519172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.556714 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1193/2403] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:37 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:37.561091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.572451 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7498d6-a8e4-4679-85a2-1cadc99f2c40 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.577290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.577959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.578277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.578556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.579288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.580931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.594459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1211/2404] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:37.595763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.607235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8d0ae-415c-4a9a-8e0b-1814dc67a5a2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.613926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58784c9a-da1b-4203-a24d-9d93975dc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.614568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784c9a-da1b-4203-a24d-9d93975dc8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.614850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784c9a-da1b-4203-a24d-9d93975dc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.615157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58784c9a-da1b-4203-a24d-9d93975dc8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.615926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58784c9a-da1b-4203-a24d-9d93975dc8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.617666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58784c9a-da1b-4203-a24d-9d93975dc8d5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.632911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1194/2405] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:37.636814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.647321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472094-8f83-477e-a97b-607a60ceb0a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.652626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.653547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.653835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.654109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] PATH_INFO: `/v3/projects/4b08481785fa47dbb5275dde5571213f/users/071eb452502a490db98c6331099f2f7a/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.671619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b08481785fa47dbb5275dde5571213f, user_id=071eb452502a490db98c6331099f2f7a, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.677080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.695817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1212/2406] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:37 2022] PUT /identity/v3/projects/4b08481785fa47dbb5275dde5571213f/users/071eb452502a490db98c6331099f2f7a/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:37.701263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.701565 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.701848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.721117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:37.722861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:37.795710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1195/2407] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:37.807863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.811828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:37.859391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:37.880317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf95e0c-442f-4dc6-b5d6-72bcb50f6802 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.884394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fb2b9-0a2b-4525-a7dc-65d9aae3ce89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.885054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb2b9-0a2b-4525-a7dc-65d9aae3ce89 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.885393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb2b9-0a2b-4525-a7dc-65d9aae3ce89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.885936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb2b9-0a2b-4525-a7dc-65d9aae3ce89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.901842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fb2b9-0a2b-4525-a7dc-65d9aae3ce89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.904080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fb2b9-0a2b-4525-a7dc-65d9aae3ce89 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.919220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1213/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:11:38.463515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:38.465154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:38.478875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc21c4-06eb-40d8-9a2d-eec4963f9728 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:38.483834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:38.484736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:38.485015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:38.485288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] PATH_INFO: `/v3/users/c9a815e098b14241b01ecc2ef4e8a675` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:38.486727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a815e098b14241b01ecc2ef4e8a675)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:38.488646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:38.564556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a815e098b14241b01ecc2ef4e8a675'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:38.574731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a815e098b14241b01ecc2ef4e8a675'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:38.575634 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a815e098b14241b01ecc2ef4e8a675'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:38.576289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a815e098b14241b01ecc2ef4e8a675'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:38.594908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a815e098b14241b01ecc2ef4e8a675'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:38.597737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:38.618125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1196/2409] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:38 2022] DELETE /identity/v3/users/c9a815e098b14241b01ecc2ef4e8a675 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:38.622493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:38.622956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:38.623064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:38.650198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:38.651759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:38.722372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1214/2410] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:38.731227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:38.733987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:38.863520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8564-d08a-4d1b-a4f1-737844d000d5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:38.874158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:38.875124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:38.875558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:38.875853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:38.917901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:38.919656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:38.938309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1197/2411] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:39.355265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:39.358026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:39.383933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24ed8-861d-42f0-b0da-5b6783fe19ec None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:39.390337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:39.391260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:39.391548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:39.391853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] PATH_INFO: `/v3/projects/fe6bf9de9cf34ea6b52532e7e57c5d83` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:39.394127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6bf9de9cf34ea6b52532e7e57c5d83)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:39.397226 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:39.494122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6bf9de9cf34ea6b52532e7e57c5d83', 'request_id': 'req-d0348795-c477-43e4-8078-ca2ceb088717'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:39.502158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6bf9de9cf34ea6b52532e7e57c5d83', 'request_id': 'req-d0348795-c477-43e4-8078-ca2ceb088717'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:39.513309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6bf9de9cf34ea6b52532e7e57c5d83', 'request_id': 'req-d0348795-c477-43e4-8078-ca2ceb088717'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:39.533861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] The token cache is being invalidate because project fe6bf9de9cf34ea6b52532e7e57c5d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:39.534156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:39.534988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d0348795-c477-43e4-8078-ca2ceb088717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:39.536903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1215/2412] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:39 2022] DELETE /identity/v3/projects/fe6bf9de9cf34ea6b52532e7e57c5d83 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:41.682662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:41.684131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:41.716870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464da37e-1558-4b30-9053-9721443847e8 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:41.867877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:41.869817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:41.870346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:41.870688 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] PATH_INFO: `/v3/users/9754b86ef0fd462b9162775d842963a5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:41.872338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9754b86ef0fd462b9162775d842963a5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:41.875645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:41.955638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9754b86ef0fd462b9162775d842963a5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:41.968642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9754b86ef0fd462b9162775d842963a5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:41.969628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9754b86ef0fd462b9162775d842963a5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:41.971020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9754b86ef0fd462b9162775d842963a5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.017620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9754b86ef0fd462b9162775d842963a5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.039984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1198/2413] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:41 2022] DELETE /identity/v3/users/9754b86ef0fd462b9162775d842963a5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:42.044998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:42.045561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:42.045561 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:42.066274 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:42.067854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:42.150075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1216/2414] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:42.160728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:42.163602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:42.212089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:42.322868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b9107-921d-4cd8-8b61-860c1978c064 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:42.328909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747387a-6d14-4b0d-8a65-c7c85ac4fb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:42.330893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747387a-6d14-4b0d-8a65-c7c85ac4fb98 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:42.331271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747387a-6d14-4b0d-8a65-c7c85ac4fb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:42.331625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747387a-6d14-4b0d-8a65-c7c85ac4fb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:42.343630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747387a-6d14-4b0d-8a65-c7c85ac4fb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:42.345878 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747387a-6d14-4b0d-8a65-c7c85ac4fb98 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:42.362337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1199/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:42.733057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:42.734783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:42.748448 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d29f32-849e-41a2-b683-ac9095a82767 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:42.768097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:42.770196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:42.770582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:42.771060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] PATH_INFO: `/v3/projects/f935c015e77f4e2292db45812d1b49ad` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:42.772621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f935c015e77f4e2292db45812d1b49ad)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:42.776859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:42.779961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:42.863335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f935c015e77f4e2292db45812d1b49ad', 'request_id': 'req-78fd8d96-402c-444a-9e22-c76e47213b64'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.872075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f935c015e77f4e2292db45812d1b49ad', 'request_id': 'req-78fd8d96-402c-444a-9e22-c76e47213b64'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.880057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f935c015e77f4e2292db45812d1b49ad', 'request_id': 'req-78fd8d96-402c-444a-9e22-c76e47213b64'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.906938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] The token cache is being invalidate because project f935c015e77f4e2292db45812d1b49ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:42.908329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.909870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-78fd8d96-402c-444a-9e22-c76e47213b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:42.912511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1217/2416] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:42 2022] DELETE /identity/v3/projects/f935c015e77f4e2292db45812d1b49ad => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:42.918264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45834a-60b6-4926-8f5d-f5a21c7a8cd8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:42.919072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45834a-60b6-4926-8f5d-f5a21c7a8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:42.919644 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45834a-60b6-4926-8f5d-f5a21c7a8cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:42.944092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:42.944395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:42.944682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:42.956439 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-df45834a-60b6-4926-8f5d-f5a21c7a8cd8 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:42.960186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df45834a-60b6-4926-8f5d-f5a21c7a8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:42.976429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] MFA Rules not processed for user `071eb452502a490db98c6331099f2f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:42.977668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:43.081711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1200/2417] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:43.089205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.089682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.089967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.128257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:43.129619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:43.134625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1218/2418] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:43.137277 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.139847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:43.144368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1201/2419] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:43.148172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.157164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51353c-22f8-4138-9404-4d776dcd0353 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.160765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a6767-267d-4fcf-86a7-2454095e10a0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.162335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.163072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.163357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.163636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.164350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.166192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.166488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.167039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.167335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.167613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.168498 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:43.168809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.170998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.193620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1202/2420] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:11:43.195369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.209003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069ec1a-4de6-4149-be7f-46d5296abb9a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.215907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.219445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1219/2421] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:43 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:43.219712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.219712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.219712 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.220313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.221302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.223725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.261180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1203/2422] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:43 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:43.265161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.308810 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:43.313230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0789b-1e8b-4afe-ba77-343f72c138db admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.341662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbfa8a-94fe-404d-9137-2c28a546db02 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.347178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.348048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.348341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.348622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.349674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.351976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.382545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1204/2423] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:43 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:43.386201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.395494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:43.400100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4c8ae-1c0e-4e6b-aa1c-47eee4d525a0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.405291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.406608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.406966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.407273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.407581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.408412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.409083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.409487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.409842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.410673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.410799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.413026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.425821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1205/2424] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:43.430034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.442522 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1220/2425] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:43 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:43.443427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.443904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adc02a-5bb1-4f82-91e2-81b8a9b42aeb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.449681 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.451082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.451477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.451891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.452746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.454440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044fd55-2714-4d3f-8251-e61f52ee012a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.454563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.463157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.463962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.467405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.467910 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.468791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.470616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.477824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1206/2426] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:11:43.478986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.489310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1221/2427] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:43.493712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.495902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60e40f-5c39-42cc-ab58-2972a4f91481 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.507013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba4e68-87ab-4f95-9823-9a82a4d09bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.508039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba4e68-87ab-4f95-9823-9a82a4d09bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.508156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba4e68-87ab-4f95-9823-9a82a4d09bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.508442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba4e68-87ab-4f95-9823-9a82a4d09bfd admin admin] PATH_INFO: `/v3/projects/332b81370b264e67a86e2632eb9a6607/users/640f3dc9501240bd8baadeadf3a88f27/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.522776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c2e52-9195-4710-a6d0-9bde4e97e289 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.535223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba4e68-87ab-4f95-9823-9a82a4d09bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=332b81370b264e67a86e2632eb9a6607, user_id=640f3dc9501240bd8baadeadf3a88f27, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.539712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.540049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba4e68-87ab-4f95-9823-9a82a4d09bfd admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.540954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.541246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.541527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] PATH_INFO: `/v3/projects/bc3c68447354406b910a024f1d6066a1/users/451775199ac7461ca925dd4cd4a56286/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.569615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1207/2428] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:43 2022] PUT /identity/v3/projects/332b81370b264e67a86e2632eb9a6607/users/640f3dc9501240bd8baadeadf3a88f27/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:43.580555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.580824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.580932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3c68447354406b910a024f1d6066a1, user_id=451775199ac7461ca925dd4cd4a56286, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.581106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.588178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.649628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1222/2429] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:43 2022] PUT /identity/v3/projects/bc3c68447354406b910a024f1d6066a1/users/451775199ac7461ca925dd4cd4a56286/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:43.651406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.656412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] MFA Rules not processed for user `640f3dc9501240bd8baadeadf3a88f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:43.658024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:43.781359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10617-604f-4b5c-a559-0262ca2fef7b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.788538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1208/2430] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:43.795250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.796211 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.796687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.797219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.800575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.802302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.802894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.809317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:43.827803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1223/2431] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:43.829264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:43.845967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a10681-b664-4705-8a88-cf468e0bbd94 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:43.853258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda27eef-d75b-4e6d-80d9-a8fece682964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:43.854730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27eef-d75b-4e6d-80d9-a8fece682964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:43.855019 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27eef-d75b-4e6d-80d9-a8fece682964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:43.855373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27eef-d75b-4e6d-80d9-a8fece682964 admin admin] PATH_INFO: `/v3/projects/bc3c68447354406b910a024f1d6066a1/users/451775199ac7461ca925dd4cd4a56286/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:43.867534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda27eef-d75b-4e6d-80d9-a8fece682964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3c68447354406b910a024f1d6066a1, user_id=451775199ac7461ca925dd4cd4a56286, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:43.870859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda27eef-d75b-4e6d-80d9-a8fece682964 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:43.896179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1224/2432] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:43 2022] PUT /identity/v3/projects/bc3c68447354406b910a024f1d6066a1/users/451775199ac7461ca925dd4cd4a56286/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:43.916161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97732dc-03fd-4aa4-b93f-dee3765a5914 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:44.009777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:44.010757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:44.010757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:44.011110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:44.035114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:44.106329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:44.108134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:44.123463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1209/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:45.607453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259022e7-c10c-44ea-a797-1dee7feb67d9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:45.607983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259022e7-c10c-44ea-a797-1dee7feb67d9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:45.607983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259022e7-c10c-44ea-a797-1dee7feb67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:45.645130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-259022e7-c10c-44ea-a797-1dee7feb67d9 None None] MFA Rules not processed for user `640f3dc9501240bd8baadeadf3a88f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:45.646264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-259022e7-c10c-44ea-a797-1dee7feb67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:45.673418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1225/2434] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:47.097594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:47.100046 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:47.288122 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775f6c2-223c-4a88-bc1b-44de480f96bc service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:47.304617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:47.305743 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:47.306403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:47.306791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] PATH_INFO: `/v3/users/79b787db677d4179bca32d9859e2972e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:47.313125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b787db677d4179bca32d9859e2972e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:47.319111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:47.444517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b787db677d4179bca32d9859e2972e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:47.463561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b787db677d4179bca32d9859e2972e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:47.472455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b787db677d4179bca32d9859e2972e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:47.473318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b787db677d4179bca32d9859e2972e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:47.495106 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b787db677d4179bca32d9859e2972e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:47.517788 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1210/2435] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:47 2022] DELETE /identity/v3/users/79b787db677d4179bca32d9859e2972e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:47.522323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:47.522778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:47.523033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:47.553507 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:47.557393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:47.636971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:47.750122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1226/2436] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:47.831119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:47.832899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:47.963702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:48.011411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57adc3-797c-40ef-944e-a3fdd73e6a38 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:48.015917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:48.016882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:48.017172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:48.017453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:48.037806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:48.039291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:48.066399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1211/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:49.489607 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:49.492076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:49.513241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51faf80b-cee4-4257-8136-7c0a2f295d6d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:49.530035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:49.531280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:49.533951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:49.534465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] PATH_INFO: `/v3/projects/ea167a2434aa49998639bf956c826d88` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:49.536678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea167a2434aa49998639bf956c826d88)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:49.541116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:49.597026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:49.598485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:49.629779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54608-b0f5-4a34-8e52-0104f1389d67 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:49.629994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea167a2434aa49998639bf956c826d88', 'request_id': 'req-4f6e635d-6525-47fb-b1fd-c69214291484'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.644586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea167a2434aa49998639bf956c826d88', 'request_id': 'req-4f6e635d-6525-47fb-b1fd-c69214291484'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.667976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea167a2434aa49998639bf956c826d88', 'request_id': 'req-4f6e635d-6525-47fb-b1fd-c69214291484'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.699649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] The token cache is being invalidate because project ea167a2434aa49998639bf956c826d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:49.700165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.706877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f6e635d-6525-47fb-b1fd-c69214291484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.711270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1227/2438] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:49 2022] DELETE /identity/v3/projects/ea167a2434aa49998639bf956c826d88 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:49.729755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:49.730776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:49.731060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:49.731335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] PATH_INFO: `/v3/users/f01d45401f08406b817d2766a0a5900c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:49.732727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01d45401f08406b817d2766a0a5900c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:49.734805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:49.892167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01d45401f08406b817d2766a0a5900c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.924370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01d45401f08406b817d2766a0a5900c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.926363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01d45401f08406b817d2766a0a5900c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.930545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01d45401f08406b817d2766a0a5900c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.962123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01d45401f08406b817d2766a0a5900c'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:49.990841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1212/2439] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:49 2022] DELETE /identity/v3/users/f01d45401f08406b817d2766a0a5900c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:50.233146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:50.233649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:50.234409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:50.264995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] MFA Rules not processed for user `451775199ac7461ca925dd4cd4a56286`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:50.266577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:50.340901 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:50.342976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:50.371613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1228/2440] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:50.388261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:50.392628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:50.495766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:50.505517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bbf05-07b0-42ae-9d08-d01516c6304e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:50.511264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:50.512377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:50.512642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:50.513342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] PATH_INFO: `/v3/projects/23a301a6181b4352872e9b2ef4ff42c8` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:50.514680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a301a6181b4352872e9b2ef4ff42c8)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:50.517267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:50.518836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:50.550491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09c42-8f86-47fc-844a-4c7a0c659d0a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:50.558159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:50.558960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:50.559234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:50.559508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:50.561586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:50.586907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a301a6181b4352872e9b2ef4ff42c8', 'request_id': 'req-a61bfdc0-28c3-4334-ab28-50db3fc96d62'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.597648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a301a6181b4352872e9b2ef4ff42c8', 'request_id': 'req-a61bfdc0-28c3-4334-ab28-50db3fc96d62'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.604776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a301a6181b4352872e9b2ef4ff42c8', 'request_id': 'req-a61bfdc0-28c3-4334-ab28-50db3fc96d62'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.619217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] The token cache is being invalidate because project 23a301a6181b4352872e9b2ef4ff42c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:50.619524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.620424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.625378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1213/2441] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:50 2022] DELETE /identity/v3/projects/23a301a6181b4352872e9b2ef4ff42c8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:11:50.626360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:50.627913 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:50.635551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:50.638844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:50.653856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1229/2442] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:50.779224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bfdc0-28c3-4334-ab28-50db3fc96d62 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:50.784633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:50.785609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:50.785957 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:50.786167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] PATH_INFO: `/v3/users/f69539a6c86d4ed89d0766b070dbdc16` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:50.789671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69539a6c86d4ed89d0766b070dbdc16)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:50.791898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:50.901881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69539a6c86d4ed89d0766b070dbdc16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.922622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69539a6c86d4ed89d0766b070dbdc16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.924425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69539a6c86d4ed89d0766b070dbdc16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.924970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69539a6c86d4ed89d0766b070dbdc16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.946196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2d9e9261-7680-4ad4-baf7-695c39933026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69539a6c86d4ed89d0766b070dbdc16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:50.982140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1214/2443] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:50 2022] DELETE /identity/v3/users/f69539a6c86d4ed89d0766b070dbdc16 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:51.528637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:51.543612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092dd4f-4174-4a8a-bbda-f7da3f92135c service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:51.649510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:51.650456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:51.650776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:51.651671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] PATH_INFO: `/v3/projects/0e1b0f6591d342d8b06e793e1d5e5308` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:51.654595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1b0f6591d342d8b06e793e1d5e5308)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:51.661404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:51.781869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1b0f6591d342d8b06e793e1d5e5308', 'request_id': 'req-d30230b4-3267-4f55-a473-676411c85611'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:51.788364 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1b0f6591d342d8b06e793e1d5e5308', 'request_id': 'req-d30230b4-3267-4f55-a473-676411c85611'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:51.814424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1b0f6591d342d8b06e793e1d5e5308', 'request_id': 'req-d30230b4-3267-4f55-a473-676411c85611'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:51.840293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] The token cache is being invalidate because project 0e1b0f6591d342d8b06e793e1d5e5308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:51.840921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:51.841850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d30230b4-3267-4f55-a473-676411c85611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:51.847954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1230/2444] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:51 2022] DELETE /identity/v3/projects/0e1b0f6591d342d8b06e793e1d5e5308 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:51.854252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:51.854891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:51.855302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:51.916872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:51.916872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:51.932486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:52.074794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1215/2445] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:52.082596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.082888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.083475 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.137494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:52.140020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:52.159349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1231/2446] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:52.165173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.182197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cc000-0eb7-4eca-9052-6f7b7281be6b None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.191942 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.192692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.192896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.193172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.194381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:11:52.194946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.197105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.217741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1216/2447] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:11:52.221906 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.233520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:52.258725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac022f7-a646-4a4d-9bb7-69173fe8f65c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.275187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.276564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.277388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.277822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.279488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.284537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.343702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.354949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1232/2448] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:11:52 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:52.386398 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130eae0-e328-4b35-a3f5-ac8d0c6993bb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.485922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.486638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.486919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.487193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.487886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.489911 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.519859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1217/2449] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:11:52 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:11:52.525101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.544440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029a98-aee9-45fb-a015-6573cad75118 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.555704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.556914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.558241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.559682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.560532 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.562315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.575405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1233/2450] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:52.579615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.596136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2bc4-9f30-4e30-a4c1-b3f19e4dfdd5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.608173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be934a-38e2-4aaa-ae08-681d4422996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.608751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be934a-38e2-4aaa-ae08-681d4422996d admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.609034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be934a-38e2-4aaa-ae08-681d4422996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.609311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be934a-38e2-4aaa-ae08-681d4422996d admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.611570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be934a-38e2-4aaa-ae08-681d4422996d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.613575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be934a-38e2-4aaa-ae08-681d4422996d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.626027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1218/2451] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:11:52.630634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.642976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d691284-5091-46b5-8924-878313cbe19a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.649219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.650791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.651198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.651586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] PATH_INFO: `/v3/projects/0f4788003c9f42adacfd231465c1009d/users/8398982a05594db8882358bf708a8f25/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.671621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4788003c9f42adacfd231465c1009d, user_id=8398982a05594db8882358bf708a8f25, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.675126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.694712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1234/2452] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:11:52 2022] PUT /identity/v3/projects/0f4788003c9f42adacfd231465c1009d/users/8398982a05594db8882358bf708a8f25/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:52.706211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973280c0-ea14-468b-80d5-6c6401579585 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.706905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973280c0-ea14-468b-80d5-6c6401579585 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.707540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973280c0-ea14-468b-80d5-6c6401579585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.740489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-973280c0-ea14-468b-80d5-6c6401579585 None None] MFA Rules not processed for user `8398982a05594db8882358bf708a8f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:52.741830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-973280c0-ea14-468b-80d5-6c6401579585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:52.822409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1219/2453] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:52.834033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:52.836779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:52.859936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.860491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.860594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.867297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:52.881637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] MFA Rules not processed for user `b9a1dadaad9b47299c666ef593bd5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:52.884109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:52.913686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e802-c927-45a8-8c64-0c6a64c35808 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:52.917490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893a62c-24fb-42c5-af83-9362403ce9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:52.918258 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a62c-24fb-42c5-af83-9362403ce9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:52.918570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a62c-24fb-42c5-af83-9362403ce9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:52.918844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893a62c-24fb-42c5-af83-9362403ce9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:52.935156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893a62c-24fb-42c5-af83-9362403ce9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:52.936605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893a62c-24fb-42c5-af83-9362403ce9f3 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:52.948505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1235/2454] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:52.979909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1220/2455] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:11:53.109083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc242557-ee9a-4435-9afa-9bdd61e445b0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:53.109083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc242557-ee9a-4435-9afa-9bdd61e445b0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:53.109083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc242557-ee9a-4435-9afa-9bdd61e445b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:53.143256 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cc242557-ee9a-4435-9afa-9bdd61e445b0 None None] MFA Rules not processed for user `071eb452502a490db98c6331099f2f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:53.144467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cc242557-ee9a-4435-9afa-9bdd61e445b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:53.220940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1236/2456] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:56.153190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:56.266031 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece48c-5b25-4055-a923-7d99cb706b78 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:56.280094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:56.281197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:56.281638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:56.282103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] PATH_INFO: `/v3/users/8398982a05594db8882358bf708a8f25` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:56.284594 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8398982a05594db8882358bf708a8f25)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:56.289515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:56.371478 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8398982a05594db8882358bf708a8f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:56.392742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8398982a05594db8882358bf708a8f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:56.393761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8398982a05594db8882358bf708a8f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:56.394419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8398982a05594db8882358bf708a8f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:56.409048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8398982a05594db8882358bf708a8f25'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:56.438317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1221/2457] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:11:56 2022] DELETE /identity/v3/users/8398982a05594db8882358bf708a8f25 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:11:56.441947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:56.442518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:56.442630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:56.464010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:11:56.465234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:56.548373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:56.572185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1237/2458] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:11:56.582100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:56.583968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:56.636707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:56.686150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61735-2a6f-43f0-8a66-7f929b87bbf6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:56.691271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f046-c17a-41aa-a910-b6be4884a1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:56.693826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f046-c17a-41aa-a910-b6be4884a1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:56.694257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f046-c17a-41aa-a910-b6be4884a1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:56.694638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f046-c17a-41aa-a910-b6be4884a1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:56.707311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f046-c17a-41aa-a910-b6be4884a1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:56.709968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f046-c17a-41aa-a910-b6be4884a1d8 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:56.734485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1222/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:57.219546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:57.221609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:11:57.244243 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cbb828-0d2f-40b7-bf91-1f1efe475022 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:57.250551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:57.252470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:57.253150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:57.253570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] PATH_INFO: `/v3/projects/0f4788003c9f42adacfd231465c1009d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:57.259367 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4788003c9f42adacfd231465c1009d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:57.261598 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:57.359040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4788003c9f42adacfd231465c1009d', 'request_id': 'req-1be6eba5-58f3-48b5-979c-48162aff1db3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:57.370425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4788003c9f42adacfd231465c1009d', 'request_id': 'req-1be6eba5-58f3-48b5-979c-48162aff1db3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:57.380218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4788003c9f42adacfd231465c1009d', 'request_id': 'req-1be6eba5-58f3-48b5-979c-48162aff1db3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:57.399765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] The token cache is being invalidate because project 0f4788003c9f42adacfd231465c1009d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:11:57.400111 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:57.401468 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:11:57.403844 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1238/2460] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:11:57 2022] DELETE /identity/v3/projects/0f4788003c9f42adacfd231465c1009d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:12:06.719335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=13 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:07.092024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c91a3-32cf-4b30-b3e9-21afb5c872d1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:07.092315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c91a3-32cf-4b30-b3e9-21afb5c872d1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:07.092600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c91a3-32cf-4b30-b3e9-21afb5c872d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:07.109974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-de2c91a3-32cf-4b30-b3e9-21afb5c872d1 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:07.112124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-de2c91a3-32cf-4b30-b3e9-21afb5c872d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:07.170174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1223/2461] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:07.211957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:07.213449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:07.283813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6eba5-58f3-48b5-979c-48162aff1db3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:07.289575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:07.290244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:07.290541 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:07.290818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:07.299908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:07.301482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:07.309688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1239/2462] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:12:07.903923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facea40-70ec-40a0-b810-ce8488c5092b None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:07.904449 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facea40-70ec-40a0-b810-ce8488c5092b None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:07.904719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facea40-70ec-40a0-b810-ce8488c5092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:07.934799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4facea40-70ec-40a0-b810-ce8488c5092b None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:07.936119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4facea40-70ec-40a0-b810-ce8488c5092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:07.944440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1224/2463] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 09:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:07.960323 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:07.972198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab31f-1040-42e0-9fa2-614dafeebef6 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:07.980273 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:07.981113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:07.981400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:07.981697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:07.991023 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:07.992874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:08.002925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1240/2464] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:12:08.234562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765c53b-51ea-4912-b66b-2a79f607ed00 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:08.234963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765c53b-51ea-4912-b66b-2a79f607ed00 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:08.235152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765c53b-51ea-4912-b66b-2a79f607ed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:08.253870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8765c53b-51ea-4912-b66b-2a79f607ed00 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:08.255100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8765c53b-51ea-4912-b66b-2a79f607ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:08.262598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1225/2465] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:12:08.275433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:08.286696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad76c74-4734-4175-875a-ba5b418dcf43 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:08.291912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:08.292560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:08.292842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:08.293301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:08.302670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:08.304200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:08.312717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1241/2466] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:12:08.672044 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194964-392f-4738-a035-1232108bdd00 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:08.672341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194964-392f-4738-a035-1232108bdd00 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:08.672660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21194964-392f-4738-a035-1232108bdd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:08.691947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-21194964-392f-4738-a035-1232108bdd00 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:08.693206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-21194964-392f-4738-a035-1232108bdd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:08.700459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1226/2467] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:08.712587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:08.723551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7ae72-de18-465c-b86d-28028a7245c6 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:08.728818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df046c0e-a814-414f-b43e-9a50817b0cdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:08.729464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046c0e-a814-414f-b43e-9a50817b0cdc service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:08.729751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046c0e-a814-414f-b43e-9a50817b0cdc service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:08.730156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df046c0e-a814-414f-b43e-9a50817b0cdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:08.739303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046c0e-a814-414f-b43e-9a50817b0cdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:08.740888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df046c0e-a814-414f-b43e-9a50817b0cdc service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:08.749371 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1242/2468] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:12:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:12:10.834892 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21194964-392f-4738-a035-1232108bdd00 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:10.836813 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-21194964-392f-4738-a035-1232108bdd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:10.918267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21194964-392f-4738-a035-1232108bdd00 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:10.923953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:10.925476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:10.925775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:10.926058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] PATH_INFO: `/v3/users/640f3dc9501240bd8baadeadf3a88f27` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:10.927992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=640f3dc9501240bd8baadeadf3a88f27)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:10.929979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:10.982896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640f3dc9501240bd8baadeadf3a88f27'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:10.990873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640f3dc9501240bd8baadeadf3a88f27'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:10.991585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640f3dc9501240bd8baadeadf3a88f27'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:10.992193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640f3dc9501240bd8baadeadf3a88f27'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.008089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640f3dc9501240bd8baadeadf3a88f27'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.028409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1227/2469] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:12:10 2022] DELETE /identity/v3/users/640f3dc9501240bd8baadeadf3a88f27 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:12:11.033353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.034257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.034724 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.052592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:11.053937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:11.079984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:11.118040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1243/2470] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:11.129039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.130759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:11.138443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:11.198570 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c282de3-9ee0-4d26-9745-1f29dd9049ac admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.202163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50f6ae-89ab-438b-8a8d-3fa25a5b7743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.202872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f6ae-89ab-438b-8a8d-3fa25a5b7743 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.203158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f6ae-89ab-438b-8a8d-3fa25a5b7743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.203434 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f6ae-89ab-438b-8a8d-3fa25a5b7743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.213607 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50f6ae-89ab-438b-8a8d-3fa25a5b7743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.215121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50f6ae-89ab-438b-8a8d-3fa25a5b7743 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.225842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1228/2471] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:11.421663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.423348 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:11.438857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a5229-3c68-47c7-95c3-42fefa1532f9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.454959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.456077 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.456374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.456634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] PATH_INFO: `/v3/projects/332b81370b264e67a86e2632eb9a6607` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.458067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332b81370b264e67a86e2632eb9a6607)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.460120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.511926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332b81370b264e67a86e2632eb9a6607', 'request_id': 'req-570e1d42-45d5-410a-8fe6-85086357da67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.517637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332b81370b264e67a86e2632eb9a6607', 'request_id': 'req-570e1d42-45d5-410a-8fe6-85086357da67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.524709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332b81370b264e67a86e2632eb9a6607', 'request_id': 'req-570e1d42-45d5-410a-8fe6-85086357da67'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.538812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] The token cache is being invalidate because project 332b81370b264e67a86e2632eb9a6607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:12:11.539106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.539741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-570e1d42-45d5-410a-8fe6-85086357da67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:12:11.541275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1244/2472] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:12:11 2022] DELETE /identity/v3/projects/332b81370b264e67a86e2632eb9a6607 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:12:11.546627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.546915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.547192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.565240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:11.566571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:11.632998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1229/2473] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:11.640995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.641285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.641600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.660377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:11.661583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:11.669688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1245/2474] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:11.674337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.693009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8ea4f-cd0b-45e5-875a-a4829365b3fc None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.697799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.698689 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.698871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.699147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.699955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:12:11.700212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.701882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.717923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1230/2475] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:12:11.722873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.733036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760052d8-f847-4cab-a35c-0809876b3c3f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.738846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.739574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.739841 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.740122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.740831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.754197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.795250 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1246/2476] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:12:11 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:12:11.799626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.810413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036495ff-ccf2-43d8-b7e0-1292595230f5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.874854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.875819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.876100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.876376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.877058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.878994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.907623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1231/2477] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:12:11 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:12:11.911605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.922483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a1a12-2c64-4239-910c-a41da57f02ce admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.927718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.928423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.928708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.928988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.929725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.931898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.943519 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1247/2478] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:12:11.947391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.959865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c33840-073d-4f4a-9a97-68b4c59a87d4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:11.966045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93bfd-8bdc-4511-b4d1-f42f4f46c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:11.966965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93bfd-8bdc-4511-b4d1-f42f4f46c306 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:11.967343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93bfd-8bdc-4511-b4d1-f42f4f46c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:11.967766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93bfd-8bdc-4511-b4d1-f42f4f46c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:11.968736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada93bfd-8bdc-4511-b4d1-f42f4f46c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:11.971197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada93bfd-8bdc-4511-b4d1-f42f4f46c306 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:11.982386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1232/2479] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:12:11.986537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:11.996885 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123648ac-3cae-4dc3-8775-ec5483b1ff8c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:12.002496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:12.003908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:12.004295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:12.004673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] PATH_INFO: `/v3/projects/de27e12e65bf42eaa2239cf93f3d766c/users/a42f7de1fdd04a9c93dce658a9395739/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:12.050529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de27e12e65bf42eaa2239cf93f3d766c, user_id=a42f7de1fdd04a9c93dce658a9395739, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:12.053291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:12.076383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1248/2480] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:12:11 2022] PUT /identity/v3/projects/de27e12e65bf42eaa2239cf93f3d766c/users/a42f7de1fdd04a9c93dce658a9395739/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:12:12.082132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38877cb2-ee86-4d23-84e9-ebc3b459d377 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:12.082486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38877cb2-ee86-4d23-84e9-ebc3b459d377 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:12.082795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38877cb2-ee86-4d23-84e9-ebc3b459d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:12.104348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-38877cb2-ee86-4d23-84e9-ebc3b459d377 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:12.105985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-38877cb2-ee86-4d23-84e9-ebc3b459d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:12.116694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:12.175003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1233/2481] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:12.184517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:12.186296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:12.244674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:12.249179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f9e4-7e52-4d9e-8d58-6e07b766b2c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:12.255060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:12.256174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:12.256639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:12.257010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:12.267309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:12.268720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:12.278290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1249/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:12.879211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd28ef9-c1d3-4dee-b39d-45165c1310f8 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:12.879703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd28ef9-c1d3-4dee-b39d-45165c1310f8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:12.879825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd28ef9-c1d3-4dee-b39d-45165c1310f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:12.907115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-5fd28ef9-c1d3-4dee-b39d-45165c1310f8 None None] MFA Rules not processed for user `a42f7de1fdd04a9c93dce658a9395739`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:12.908330 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-5fd28ef9-c1d3-4dee-b39d-45165c1310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:12.975693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1234/2483] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:12:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:12.986886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:12.988278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:13.065815 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70019068-b183-441c-a48b-8823237668d6 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:13.069472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:13.070351 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:13.070634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:13.070908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:13.079670 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:13.081085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:13.089935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1250/2484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:14.427174 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefaf5a-536c-4b5a-9d07-23a25539d026 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:14.427558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefaf5a-536c-4b5a-9d07-23a25539d026 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:14.427730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefaf5a-536c-4b5a-9d07-23a25539d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:14.445346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6cefaf5a-536c-4b5a-9d07-23a25539d026 None None] MFA Rules not processed for user `a42f7de1fdd04a9c93dce658a9395739`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:14.446493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6cefaf5a-536c-4b5a-9d07-23a25539d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:14.453391 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1235/2485] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:19.382033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:19.383548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:19.396308 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0ee17-d585-4879-a9b5-f9b6ab6de4ce service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:19.399831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:19.400465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:19.400744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:19.401021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:19.403599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:19.471927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:19.473350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:19.483067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1251/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:24.440736 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=56 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:29.478753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=60 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:43.220647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b8a0-f0a1-42e1-8cb0-c79fe3ff7e56 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:43.221157 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b8a0-f0a1-42e1-8cb0-c79fe3ff7e56 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:43.221268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b8a0-f0a1-42e1-8cb0-c79fe3ff7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:43.298675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e2d6b8a0-f0a1-42e1-8cb0-c79fe3ff7e56 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:43.299885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e2d6b8a0-f0a1-42e1-8cb0-c79fe3ff7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:43.349032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1236/2487] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:43.363326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:43.364730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:43.489659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f07600-c6e6-422c-a34a-8f2fae10e715 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:43.495185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:43.495833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:43.496119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:43.496399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:43.504703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:43.506307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:43.515684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1252/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:46.263537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b8b5-6378-433f-b510-0b9776f7cecb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:46.264186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b8b5-6378-433f-b510-0b9776f7cecb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:46.264536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b8b5-6378-433f-b510-0b9776f7cecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:46.282563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-2da8b8b5-6378-433f-b510-0b9776f7cecb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:46.283747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2da8b8b5-6378-433f-b510-0b9776f7cecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:46.292198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1237/2489] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:46.317066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:46.328007 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72890-a623-4552-8b1e-05af7844ccbe service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:46.333319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:46.333943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:46.334246 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:46.334524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:46.343126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:46.344681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:46.354576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1253/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:12:49.478369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64f5f-f3a9-4d3b-b117-2bc409e7ea89 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:49.478967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64f5f-f3a9-4d3b-b117-2bc409e7ea89 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:49.478967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64f5f-f3a9-4d3b-b117-2bc409e7ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:49.496305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-04c64f5f-f3a9-4d3b-b117-2bc409e7ea89 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:49.497479 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-04c64f5f-f3a9-4d3b-b117-2bc409e7ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:49.505429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1238/2491] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:49.520068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:49.521461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:49.536501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac52b2e-96ce-4a91-88d3-e4ecbc2c10f1 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:49.542625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:49.543205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:49.543490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:49.543770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:49.551827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:49.553385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:49.562806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1254/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:52.561009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49d91-b832-4d03-9bc9-0e3557fd2f5a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:52.561496 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49d91-b832-4d03-9bc9-0e3557fd2f5a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:52.561593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49d91-b832-4d03-9bc9-0e3557fd2f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:52.580234 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a9d49d91-b832-4d03-9bc9-0e3557fd2f5a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:52.581428 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a9d49d91-b832-4d03-9bc9-0e3557fd2f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:52.590290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1239/2493] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:52.611118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:52.642259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61165d-f011-460a-bff5-8937fa846973 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:52.648715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:52.649393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:52.649679 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:52.649959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:52.658328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:52.659903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:52.669315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1255/2494] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:12:56.731115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568336c-0b97-4161-9a86-abeea3b8b183 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:56.731611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568336c-0b97-4161-9a86-abeea3b8b183 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:56.731718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568336c-0b97-4161-9a86-abeea3b8b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:56.749172 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-a568336c-0b97-4161-9a86-abeea3b8b183 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:12:56.750375 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a568336c-0b97-4161-9a86-abeea3b8b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:12:56.758446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1240/2495] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:12:56.776161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:12:56.787172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96121ef5-9947-4797-8dcf-45a897438727 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:12:56.793191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:12:56.793838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:12:56.794116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:12:56.794415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:12:56.802759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:12:56.804310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:12:56.813640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1256/2496] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:01.933369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:01.933861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:01.933962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:01.951323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:01.952526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:01.960219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1241/2497] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:01.974454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:01.986099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5313b3a-6d50-4fe4-b5c3-a88a03ea7f5a service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:01.991703 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e21d74-812a-43de-941d-693002b53a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:01.992424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21d74-812a-43de-941d-693002b53a6f service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:01.992735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21d74-812a-43de-941d-693002b53a6f service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:01.992968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e21d74-812a-43de-941d-693002b53a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:02.001590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e21d74-812a-43de-941d-693002b53a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:02.003195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e21d74-812a-43de-941d-693002b53a6f service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:02.012757 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1257/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:03.020533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:03.021939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:03.110591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dbdc2-6383-4731-a4be-25293adbf438 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:03.115619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:03.116298 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:03.116589 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:03.116871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:03.119263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:03.130732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:03.132310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc925d7-8fde-44a7-89e2-e114af120bd1 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:03.136623 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:03.143284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1242/2499] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:12.008391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:13.139752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:14.748801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d00db-852b-491f-893e-70cda769ac51 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:14.749713 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d00db-852b-491f-893e-70cda769ac51 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:14.750159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d00db-852b-491f-893e-70cda769ac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:14.769639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6d9d00db-852b-491f-893e-70cda769ac51 None None] MFA Rules not processed for user `b9a1dadaad9b47299c666ef593bd5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:14.771105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6d9d00db-852b-491f-893e-70cda769ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:14.826143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1258/2500] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:13:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:19.429964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:19.430527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:19.430527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:19.450169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] MFA Rules not processed for user `a42f7de1fdd04a9c93dce658a9395739`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:19.451341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:19.458792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1243/2501] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:24.819377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=25 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:29.443596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:32.452354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6214bda-2990-4612-9ae6-ec1273598c70 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:32.452912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6214bda-2990-4612-9ae6-ec1273598c70 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:32.452912 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6214bda-2990-4612-9ae6-ec1273598c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:32.471202 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c6214bda-2990-4612-9ae6-ec1273598c70 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:32.472404 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6214bda-2990-4612-9ae6-ec1273598c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:32.480088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1259/2502] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:32.497095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:32.510770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0516d6-8eeb-4162-8664-c9e4531fc056 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:32.516127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:32.516756 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:32.517038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:32.517317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:32.526365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:32.527937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:32.537409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1244/2503] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:35.708093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43fede-baae-4a03-859d-47d2ee6fb152 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:35.708632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43fede-baae-4a03-859d-47d2ee6fb152 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:35.708632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43fede-baae-4a03-859d-47d2ee6fb152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:35.726151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4d43fede-baae-4a03-859d-47d2ee6fb152 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:35.727418 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4d43fede-baae-4a03-859d-47d2ee6fb152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:35.735460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1260/2504] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:13:35.754725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:35.766278 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdb31f-eca0-4820-8aa3-a9cffb0b2851 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:35.771693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:35.772315 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:35.772597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:35.772875 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:35.780917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:35.782504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:35.791687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1245/2505] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:38.781302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ea9d8-a1ab-4e5c-b03a-a94e398f3bd9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:38.781759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ea9d8-a1ab-4e5c-b03a-a94e398f3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:38.781851 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ea9d8-a1ab-4e5c-b03a-a94e398f3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:38.799266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f3ea9d8-a1ab-4e5c-b03a-a94e398f3bd9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:38.800432 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f3ea9d8-a1ab-4e5c-b03a-a94e398f3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:38.808599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1261/2506] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:38.823070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:38.835806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f83dbc-970b-43ce-87d7-1ec6a6748dbf service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:38.841436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:38.842074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:38.842413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:38.842699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:38.850861 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:38.852431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:38.862100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1246/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:41.924846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c94d-6aa2-4aae-bfe4-c45b5156484a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:41.925319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c94d-6aa2-4aae-bfe4-c45b5156484a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:41.925503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3c94d-6aa2-4aae-bfe4-c45b5156484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:41.943897 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0ba3c94d-6aa2-4aae-bfe4-c45b5156484a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:41.945079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0ba3c94d-6aa2-4aae-bfe4-c45b5156484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:41.953621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1262/2508] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:41.969343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:41.981096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a12ac4-8442-439a-872e-33f35fc91a76 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:41.986582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:41.987215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:41.987512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:41.987792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:41.996399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:41.997968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:42.008022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1247/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:45.093119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:45.093579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:45.093762 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:45.112606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:13:45.113787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:45.122148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1263/2510] 10.222.0.18 () {58 vars in 1016 bytes} [Fri Jun 24 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:13:45.141822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:45.152884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d05d2-b2f5-4393-bf5b-9ff705b74058 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:45.158380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:45.159009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:45.159293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:45.159574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:45.168222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:45.169783 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:45.179147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1248/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:55.107103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=15 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:55.175004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=30 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:12.905707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:12.916473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b2e2-8bc6-4fea-9940-cfda877851d2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:12.921751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:12.923016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:12.923301 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:12.923580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] PATH_INFO: `/v3/users/a42f7de1fdd04a9c93dce658a9395739` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:12.924837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42f7de1fdd04a9c93dce658a9395739)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:12.926832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:12.978921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42f7de1fdd04a9c93dce658a9395739'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:12.989821 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42f7de1fdd04a9c93dce658a9395739'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:12.990793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42f7de1fdd04a9c93dce658a9395739'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.000153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42f7de1fdd04a9c93dce658a9395739'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.000880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ff7594dd-a34e-4605-af1f-63a93d53d110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42f7de1fdd04a9c93dce658a9395739'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.037384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1264/2512] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:14:12 2022] DELETE /identity/v3/users/a42f7de1fdd04a9c93dce658a9395739 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:14:13.214407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.225108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1f4c4-cb7b-4225-b89a-5b0627f17f45 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.283652 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.284519 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.284808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.285088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] PATH_INFO: `/v3/projects/de27e12e65bf42eaa2239cf93f3d766c` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.286314 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de27e12e65bf42eaa2239cf93f3d766c)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.288221 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.335432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de27e12e65bf42eaa2239cf93f3d766c', 'request_id': 'req-9bc90959-d004-44df-ad69-18091bb15978'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.341799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de27e12e65bf42eaa2239cf93f3d766c', 'request_id': 'req-9bc90959-d004-44df-ad69-18091bb15978'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.348388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de27e12e65bf42eaa2239cf93f3d766c', 'request_id': 'req-9bc90959-d004-44df-ad69-18091bb15978'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.361930 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] The token cache is being invalidate because project de27e12e65bf42eaa2239cf93f3d766c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:14:13.362301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.362925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9bc90959-d004-44df-ad69-18091bb15978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:13.364886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1249/2513] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:14:13 2022] DELETE /identity/v3/projects/de27e12e65bf42eaa2239cf93f3d766c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:14:13.369972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.370268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.370555 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.388893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:13.390094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:13.451052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1265/2514] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:14:13.459518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.459809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.460088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.483024 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:13.484219 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:13.492149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1250/2515] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:13.496560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.507488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc533-e798-499b-872c-d114fddec261 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.512623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.513275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.513580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.513859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.514630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:14:13.514941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.516524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.529055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1266/2516] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:14:13.533461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.542780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52aad7-9fa6-447f-87f6-7b0efb9d6632 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.547602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.548244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.548524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.548802 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.549485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.551404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.581907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1251/2517] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:14:13 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:14:13.583063 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.593784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679e99d-caeb-4d13-91dd-5bdcb3862ae6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.651396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.652070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.652357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.652716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.653949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.655904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.662447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:13.676303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1267/2518] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:14:13 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:14:13.680395 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.690763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaf318-b679-4984-864c-498433d263d1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.695329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.695976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.696253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.696529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.697247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.698941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.709561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1252/2519] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:14:13.713176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.723647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815250c-9ecb-4378-9e5a-248f6c27f5d6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.728224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41b060-6c9e-4a34-936a-46851d2def03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.728866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b060-6c9e-4a34-936a-46851d2def03 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.729148 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b060-6c9e-4a34-936a-46851d2def03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.729424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41b060-6c9e-4a34-936a-46851d2def03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.730144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41b060-6c9e-4a34-936a-46851d2def03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.731829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41b060-6c9e-4a34-936a-46851d2def03 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.741719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1268/2520] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:14:13.745489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.755608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150247a2-e5e3-441d-bf5b-2788e321ed0e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.760348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.761211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.761497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.761779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] PATH_INFO: `/v3/projects/df10fec88e014e1fa24fa9b09a09f477/users/c91cd3519ed44653ac365c22431634e7/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.776651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=df10fec88e014e1fa24fa9b09a09f477, user_id=c91cd3519ed44653ac365c22431634e7, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.779966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.792111 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1253/2521] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:14:13 2022] PUT /identity/v3/projects/df10fec88e014e1fa24fa9b09a09f477/users/c91cd3519ed44653ac365c22431634e7/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:14:13.797121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3321-d880-4731-96af-a754ce90e9eb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.797441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3321-d880-4731-96af-a754ce90e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.797723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd3321-d880-4731-96af-a754ce90e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.815576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-82cd3321-d880-4731-96af-a754ce90e9eb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:13.816765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-82cd3321-d880-4731-96af-a754ce90e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:13.873800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1269/2522] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:13.883621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:13.885290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:13.915501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:13.964105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a6aa-f97c-4464-bb23-377b41106ccf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:13.967891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:13.968562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:13.968842 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:13.969117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:13.978040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:13.979486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:13.988814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1254/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:14:18.554784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:18.555249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:18.555361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:18.581798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] MFA Rules not processed for user `c91cd3519ed44653ac365c22431634e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:18.583076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:18.657530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1270/2524] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:14:18.662346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:18.673426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55fa9f-c851-438d-b609-f8f3664c6d4c service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:18.678040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:18.678790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:18.678991 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:18.679301 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:18.679995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:18.683148 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:18.708961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1255/2525] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:14:18 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:14:18.713161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:18.724530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5012-cba8-4034-8f04-c37d49acd9c7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:18.780360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:18.781032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:18.781315 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:18.781588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:18.782309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:18.784257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:18.798818 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:18.809094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1271/2526] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:14:18 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:14:18.809721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:18.820828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b8ee8-c680-40fe-a5c8-c1e8c8b7950f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:18.826150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:18.826854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:18.827138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:18.827413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:18.828149 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:18.829980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:18.843155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1256/2527] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:14:18.847539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:18.858172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54d60d-786b-489e-82e9-b4f4604a2641 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:18.863113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:18.864013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:18.864300 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:18.864579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] PATH_INFO: `/v3/projects/326346664d0642bd8f7bcee9c9ca3f14/users/d699fe926d6f4c05aa511d8c7628f074/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:18.880161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] RBAC: Authorizing `identity:create_grant(project_id=326346664d0642bd8f7bcee9c9ca3f14, user_id=d699fe926d6f4c05aa511d8c7628f074, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:18.882788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:18.895719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1272/2528] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:14:18 2022] PUT /identity/v3/projects/326346664d0642bd8f7bcee9c9ca3f14/users/d699fe926d6f4c05aa511d8c7628f074/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:14:18.899899 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:18.910946 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d37d-3a42-498d-ae35-8728c789f257 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:18.968914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965254b-8366-4fc1-a144-a906df65dc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:18.969598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965254b-8366-4fc1-a144-a906df65dc3f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:18.969882 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965254b-8366-4fc1-a144-a906df65dc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:18.970151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965254b-8366-4fc1-a144-a906df65dc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:18.970917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965254b-8366-4fc1-a144-a906df65dc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:18.972529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965254b-8366-4fc1-a144-a906df65dc3f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:18.983262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1257/2529] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:14:18.987433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:18.997586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc33d38-c4b9-4f63-8f90-185adfb614df admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:19.002457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:19.003328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:19.003609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:19.003884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] PATH_INFO: `/v3/projects/326346664d0642bd8f7bcee9c9ca3f14/users/d699fe926d6f4c05aa511d8c7628f074/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:19.005843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326346664d0642bd8f7bcee9c9ca3f14, user_id=d699fe926d6f4c05aa511d8c7628f074, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:19.008505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:19.020145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1273/2530] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:14:18 2022] PUT /identity/v3/projects/326346664d0642bd8f7bcee9c9ca3f14/users/d699fe926d6f4c05aa511d8c7628f074/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:14:23.986865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:23.987290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:23.987438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.068748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:24.071475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] MFA Rules not processed for user `d699fe926d6f4c05aa511d8c7628f074`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:24.073460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.076805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.165936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:24.176522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1258/2531] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:24.181867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5dccd-4f89-42b0-b405-b39672390a20 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:24.185732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:24.187536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.188736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:24.189805 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:24.190325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:24.190774 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] PATH_INFO: `/v3/users/b9a1dadaad9b47299c666ef593bd5bec` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.192395 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a1dadaad9b47299c666ef593bd5bec)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:24.194746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:24.252306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a1dadaad9b47299c666ef593bd5bec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.260552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a1dadaad9b47299c666ef593bd5bec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.261630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a1dadaad9b47299c666ef593bd5bec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.270562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a1dadaad9b47299c666ef593bd5bec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.272185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-05c15f4f-113c-4a7f-b17c-afef2bf8cd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a1dadaad9b47299c666ef593bd5bec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.285722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cdc27-d81f-45ad-9b0e-f10f9d899f04 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:24.289528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:24.290178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:24.290503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:24.290773 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.292778 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.299234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1274/2532] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:14:24 2022] DELETE /identity/v3/users/b9a1dadaad9b47299c666ef593bd5bec => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:14:24.363035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:24.364488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:24.379751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1259/2533] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:14:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:14:24.505902 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:24.506200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:24.506514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.551120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:24.553262 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.572539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea2ab-cd3f-4c78-8d2a-2f3f192d255a service glance] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:24.594430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:24.610333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:24.611924 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.667322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:24.668832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:24.669116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:24.669390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] PATH_INFO: `/v3/projects/f282215469e8463481d609437b9818a0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.670713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f282215469e8463481d609437b9818a0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:24.673586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:24.711777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1275/2534] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:14:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:24.727042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:24.745045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f282215469e8463481d609437b9818a0', 'request_id': 'req-37f9e81a-fb80-4414-a9c9-976f3cdfd448'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.755932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f282215469e8463481d609437b9818a0', 'request_id': 'req-37f9e81a-fb80-4414-a9c9-976f3cdfd448'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.763481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f282215469e8463481d609437b9818a0', 'request_id': 'req-37f9e81a-fb80-4414-a9c9-976f3cdfd448'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.774554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:24.775972 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.779268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] The token cache is being invalidate because project f282215469e8463481d609437b9818a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:14:24.779635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.780406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-37f9e81a-fb80-4414-a9c9-976f3cdfd448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:14:24.785693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1260/2535] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:14:24 2022] DELETE /identity/v3/projects/f282215469e8463481d609437b9818a0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:14:24.788660 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8944d-c48a-4bf8-9ba1-95ef2a447636 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:24.789074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8944d-c48a-4bf8-9ba1-95ef2a447636 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:24.789423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8944d-c48a-4bf8-9ba1-95ef2a447636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.813715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-b0d8944d-c48a-4bf8-9ba1-95ef2a447636 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:24.819367 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-b0d8944d-c48a-4bf8-9ba1-95ef2a447636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.914129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fdaf-9e15-4d46-9ee7-c15d5e893ffe None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:24.939871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1261/2536] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:24.952134 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:24.952366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:24.952650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:24.973207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:24.974554 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:24.986387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1262/2537] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:24.988307 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.004020 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.004597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463662d-26c0-44ba-ad4f-8f4af764b1bb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.004769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.004976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.005257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.007206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:25.011445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.012774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.013245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.013531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.014319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:14:25.014636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.016657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.034322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1263/2538] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:14:25.039052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.045757 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:25.051755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57bddd-56c9-4bcb-8d41-7e40099dffaf admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.057072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.058180 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.058508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.059322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.060017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.062083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.084646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.086135 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.095284 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1276/2539] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:14:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:14:25.096451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1264/2540] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:14:25 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:14:25.100680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.111925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3312da-64fd-42fe-b71a-0b1d7a8e3c4d service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.203995 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.204587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.204879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.205154 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.205853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.207808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.234584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1277/2541] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:14:25 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:14:25.236202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.249497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36450e-302e-42a7-a3af-11d6669f2a03 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.256187 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.257303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.257767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.258196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.259144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.260912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.280108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1265/2542] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:14:25.280812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.293406 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05784881-f090-4f70-8f4c-f2e1d6ea04c1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.298965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36e721-8e18-4d99-b093-2b278c1bd5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.299649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36e721-8e18-4d99-b093-2b278c1bd5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.300116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36e721-8e18-4d99-b093-2b278c1bd5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.300215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36e721-8e18-4d99-b093-2b278c1bd5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.300926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36e721-8e18-4d99-b093-2b278c1bd5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.305379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36e721-8e18-4d99-b093-2b278c1bd5a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.325931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1278/2543] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:14:25.328406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.344533 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7357a5-4146-411e-980b-4bec4237e4b0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.349964 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.350947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.351286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.351591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] PATH_INFO: `/v3/projects/312a47e3783b4ffc84c1f04851504a9d/users/3d5dbf6f382f4ec1a174f961c7ffb2a1/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.373080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=312a47e3783b4ffc84c1f04851504a9d, user_id=3d5dbf6f382f4ec1a174f961c7ffb2a1, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.376073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.409103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1266/2544] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:14:25 2022] PUT /identity/v3/projects/312a47e3783b4ffc84c1f04851504a9d/users/3d5dbf6f382f4ec1a174f961c7ffb2a1/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:14:25.413676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f5407-b049-410a-bcb3-24596cf4bb5b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.413969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f5407-b049-410a-bcb3-24596cf4bb5b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.414275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f5407-b049-410a-bcb3-24596cf4bb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.438896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-436f5407-b049-410a-bcb3-24596cf4bb5b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:25.440110 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-436f5407-b049-410a-bcb3-24596cf4bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:25.538240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1279/2545] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:25.547183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:25.549063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:25.629460 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:25.642849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25085c8c-5d20-4c76-a5ba-43de6a974f0f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:25.648885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:25.649552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:25.649832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:25.650110 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:25.661995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:25.663500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:25.675495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1267/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:14:31.741929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660aaf6-0801-4f17-8960-7ec81189fd04 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:31.742866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660aaf6-0801-4f17-8960-7ec81189fd04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:31.743333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660aaf6-0801-4f17-8960-7ec81189fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:31.789621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3660aaf6-0801-4f17-8960-7ec81189fd04 None None] MFA Rules not processed for user `3d5dbf6f382f4ec1a174f961c7ffb2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:31.791572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3660aaf6-0801-4f17-8960-7ec81189fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:31.849291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:31.913228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1280/2547] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:31.921355 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:31.923921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:32.058648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31cb90-21ff-4bff-b05b-51512f2d5604 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:32.065938 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc057f-0a2f-4ce3-8329-bf351fb61c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:32.066641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc057f-0a2f-4ce3-8329-bf351fb61c41 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:32.066926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc057f-0a2f-4ce3-8329-bf351fb61c41 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:32.067226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc057f-0a2f-4ce3-8329-bf351fb61c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:32.080349 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc057f-0a2f-4ce3-8329-bf351fb61c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:32.082042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc057f-0a2f-4ce3-8329-bf351fb61c41 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:32.093159 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1268/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:14:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:14:34.103496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2834f6-a450-487c-b5af-a5abdf8c1051 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:34.104441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2834f6-a450-487c-b5af-a5abdf8c1051 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:34.104889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2834f6-a450-487c-b5af-a5abdf8c1051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:34.124384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7a2834f6-a450-487c-b5af-a5abdf8c1051 None None] MFA Rules not processed for user `3d5dbf6f382f4ec1a174f961c7ffb2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:34.125853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a2834f6-a450-487c-b5af-a5abdf8c1051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:34.140247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1281/2549] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:38.011515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:38.012612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:38.012612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:38.030077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] MFA Rules not processed for user `c91cd3519ed44653ac365c22431634e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:38.031497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:38.086019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1269/2550] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:14:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:40.225712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d12c4-c82f-442c-b2a2-d793068e314e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:40.226985 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d12c4-c82f-442c-b2a2-d793068e314e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:40.227501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d12c4-c82f-442c-b2a2-d793068e314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:40.252996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ff6d12c4-c82f-442c-b2a2-d793068e314e None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:40.254949 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ff6d12c4-c82f-442c-b2a2-d793068e314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:40.354517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1282/2551] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:40.361897 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:40.366647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:40.505089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf09b1-5795-4039-abea-234e6535f2c3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:40.513768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f44f91-53a5-49c7-9fa5-ae746c030b3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:40.514968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f44f91-53a5-49c7-9fa5-ae746c030b3d service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:40.516114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f44f91-53a5-49c7-9fa5-ae746c030b3d service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:40.516598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f44f91-53a5-49c7-9fa5-ae746c030b3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:40.527596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f44f91-53a5-49c7-9fa5-ae746c030b3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:40.529544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f44f91-53a5-49c7-9fa5-ae746c030b3d service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:40.535377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:40.554609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1270/2552] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:14:50.326487 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=39 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:50.540894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:55.891904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15af99-3789-4de2-b9b2-33f80626113e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:55.892431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15af99-3789-4de2-b9b2-33f80626113e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:55.892431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15af99-3789-4de2-b9b2-33f80626113e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:55.894328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1283/2553] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:14:55.900077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725e34c-bc4b-41e3-8b75-6eec01a9f23c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:55.900608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725e34c-bc4b-41e3-8b75-6eec01a9f23c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:55.900695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725e34c-bc4b-41e3-8b75-6eec01a9f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:55.923251 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-1725e34c-bc4b-41e3-8b75-6eec01a9f23c None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:55.924651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-1725e34c-bc4b-41e3-8b75-6eec01a9f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:55.931447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1271/2554] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:55.943798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15af99-3789-4de2-b9b2-33f80626113e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:55.945529 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4f15af99-3789-4de2-b9b2-33f80626113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:55.960080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15af99-3789-4de2-b9b2-33f80626113e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:55.963785 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966223d-7d71-4f2f-b184-3739d317efa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:55.965024 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966223d-7d71-4f2f-b184-3739d317efa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:55.965370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966223d-7d71-4f2f-b184-3739d317efa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:55.965711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966223d-7d71-4f2f-b184-3739d317efa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:55.973591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966223d-7d71-4f2f-b184-3739d317efa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:55.975190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966223d-7d71-4f2f-b184-3739d317efa2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:55.984566 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1284/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:14:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:14:56.072657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c3e1-8de9-4ddf-bb8e-a647a01636f8 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:56.072947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c3e1-8de9-4ddf-bb8e-a647a01636f8 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:56.073223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c3e1-8de9-4ddf-bb8e-a647a01636f8 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:56.074806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1272/2556] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:14:56.080584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505891d1-2dfa-4c73-b99f-e7426383d378 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:56.080881 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505891d1-2dfa-4c73-b99f-e7426383d378 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:56.081228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505891d1-2dfa-4c73-b99f-e7426383d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:56.120712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-505891d1-2dfa-4c73-b99f-e7426383d378 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:14:56.121927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-505891d1-2dfa-4c73-b99f-e7426383d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:14:56.132438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1285/2557] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:14:56.143699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c3e1-8de9-4ddf-bb8e-a647a01636f8 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:14:56.155400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c3e1-8de9-4ddf-bb8e-a647a01636f8 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:14:56.159092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:14:56.159720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:14:56.160001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:14:56.160275 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:14:56.171450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:14:56.172866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:14:56.183803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1273/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:00.503704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:00.504205 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:00.504518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:00.522683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] MFA Rules not processed for user `721196c95841441cae4b48022d6e0d30`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:15:00.523908 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:00.580523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1286/2559] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:15:00.884514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:00.893551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0107a-783e-4c64-840f-49c8c9e99e35 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:00.897127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:00.897754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:00.898040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:00.898421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:00.900144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:00.913830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:00.915289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:00.926103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1274/2560] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:01.072101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:01.082595 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8abf8-f24b-492d-9091-e73ce032f5ed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:01.086163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:01.086838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:01.087125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:01.087405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:01.089240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:01.105210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:01.106681 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:01.118352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1287/2561] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:09.012030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:09.020612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600eb4-4071-4076-b740-d9ad7be44932 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:09.024247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:09.024886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:09.025168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:09.025447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:09.027269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:09.095737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:09.097177 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff909-8d25-4ca3-adc0-fe7b36107740 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:09.107279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1275/2562] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:11.113257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=46 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:19.102502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=45 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:44.790255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:44.798981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e1ec9-f4c0-428f-b047-a84739ba06de service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:44.802898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:44.803542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:44.803832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:44.804108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:44.805896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:44.816422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:44.817832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:44.826031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1288/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:54.822494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:02.336047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:02.336574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:02.336687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:02.354190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:02.355433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:02.363240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1276/2564] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:02.402377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:02.415182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a33d60-6252-4378-8846-8018c336a0c1 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:02.420238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:02.420872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:02.421161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:02.421440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:02.430502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:02.432122 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:02.440183 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1289/2565] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:16:03.790636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:03.809905 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ac614-577c-4da1-b993-0536a75aeb3f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:03.817370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:03.818344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:03.818806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:03.819332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:03.821311 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:03.837823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:03.839520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:03.866556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1277/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:12.436931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:13.766542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:13.767901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:13.783032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc6855-77ab-46a8-836b-f820be1cf19d service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:13.788403 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:13.789038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:13.789334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:13.789596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:13.791373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:13.803827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:13.805393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f268d-5f2d-44d5-9859-8e5d0b9cfb97 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:13.816559 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1290/2567] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:13.847095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=9 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:14.490702 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:14.505340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac02716-a037-4cab-865c-a4d7354d9084 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:14.511444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:14.512632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:14.513128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:14.513408 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:14.515516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:14.527550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:14.529909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86105c-6ba3-4145-b2df-9c8c0d3094ad service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:14.540877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1278/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:16.518502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67de5a-ee07-4b2e-8876-83b4435a8cf8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:16.519493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67de5a-ee07-4b2e-8876-83b4435a8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:16.519777 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67de5a-ee07-4b2e-8876-83b4435a8cf8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:16.521845 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1291/2569] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:16:16.527730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:16.528227 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:16.528473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:16.549550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:16.551192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:16.560569 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1279/2570] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:16:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:16.572358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67de5a-ee07-4b2e-8876-83b4435a8cf8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:16.574045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1d67de5a-ee07-4b2e-8876-83b4435a8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:16.636694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67de5a-ee07-4b2e-8876-83b4435a8cf8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:16.641761 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e43ba-512e-4cf5-bfba-13d3cf98c7fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:16.642452 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e43ba-512e-4cf5-bfba-13d3cf98c7fd service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:16.642735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e43ba-512e-4cf5-bfba-13d3cf98c7fd service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:16.643013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e43ba-512e-4cf5-bfba-13d3cf98c7fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:16.655392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e43ba-512e-4cf5-bfba-13d3cf98c7fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:16.658002 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e43ba-512e-4cf5-bfba-13d3cf98c7fd service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:16.669758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1292/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:16:16.862527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:16.863975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:16.930190 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd81526-d993-49e8-a680-a53f01a73dd3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:16.935015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:16.935650 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:16.935932 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:16.936207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:16.937966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:16.949312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:16.951337 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:16.961628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1280/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:18.876817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:18.877272 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:18.877514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:18.895554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:18.896874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:18.904401 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1293/2573] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:16:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:18.916884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:18.928944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874723ef-93eb-48aa-8637-d441b310b42b service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:18.934694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e07e7-d0cc-4540-a1ce-9f3ce998ee28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:18.935340 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e07e7-d0cc-4540-a1ce-9f3ce998ee28 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:18.935627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e07e7-d0cc-4540-a1ce-9f3ce998ee28 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:18.935912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e07e7-d0cc-4540-a1ce-9f3ce998ee28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:18.945316 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e07e7-d0cc-4540-a1ce-9f3ce998ee28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:18.947008 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e07e7-d0cc-4540-a1ce-9f3ce998ee28 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:18.956318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1281/2574] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:16:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:16:19.963402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:19.974362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3f57-18aa-4f27-ae24-44e9084a117d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:19.978043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:19.978930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:19.979393 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:19.979958 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:19.982837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:19.999084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:20.000884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe3a9d-2c6d-4ffc-bdc7-3f25e70ce7f4 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:20.011909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1294/2575] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:24.024655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b78cc8-e7ea-46b8-afa6-be3508a5ced0 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.025245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b78cc8-e7ea-46b8-afa6-be3508a5ced0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.025245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b78cc8-e7ea-46b8-afa6-be3508a5ced0 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.027781 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1282/2576] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:16:24.042744 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.043649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.044079 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.102920 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] MFA Rules not processed for user `c2b5e5bb5b614905b7ff314b54bf8097`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:24.105631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:24.116939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1295/2577] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:24.128103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b78cc8-e7ea-46b8-afa6-be3508a5ced0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:24.130300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c7b78cc8-e7ea-46b8-afa6-be3508a5ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:24.141592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:24.153000 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872521-5b66-47e3-87e0-f58becb40cfd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:24.160912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b78cc8-e7ea-46b8-afa6-be3508a5ced0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:24.163208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:24.163934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.164224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.164536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.174297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:24.175183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.175470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.175750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] PATH_INFO: `/v3/users/721196c95841441cae4b48022d6e0d30` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.176651 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:24.177070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721196c95841441cae4b48022d6e0d30)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:24.179226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:24.179644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:24.196503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1296/2578] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:24.263854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721196c95841441cae4b48022d6e0d30'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.271617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721196c95841441cae4b48022d6e0d30'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.272400 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721196c95841441cae4b48022d6e0d30'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.273086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721196c95841441cae4b48022d6e0d30'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.286904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b35e558c-5937-49e8-a4a4-4a7c1ac973a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721196c95841441cae4b48022d6e0d30'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.312166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1283/2579] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:16:24 2022] DELETE /identity/v3/users/721196c95841441cae4b48022d6e0d30 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:24.523147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:24.552672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197fa96-8b2d-4d84-9e9c-e27a13d30349 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:24.635298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:24.637051 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.637416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.637766 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] PATH_INFO: `/v3/projects/2abe00d76fdf4d958fc1256c5123b069` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.639259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abe00d76fdf4d958fc1256c5123b069)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:24.641523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:24.699741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:24.707691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abe00d76fdf4d958fc1256c5123b069', 'request_id': 'req-1bb81f0e-0902-42af-9591-627ca7fb54a8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.713477 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abe00d76fdf4d958fc1256c5123b069', 'request_id': 'req-1bb81f0e-0902-42af-9591-627ca7fb54a8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.720862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abe00d76fdf4d958fc1256c5123b069', 'request_id': 'req-1bb81f0e-0902-42af-9591-627ca7fb54a8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.737084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] The token cache is being invalidate because project 2abe00d76fdf4d958fc1256c5123b069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:16:24.737389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.738120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1bb81f0e-0902-42af-9591-627ca7fb54a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:24.740443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1297/2580] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:16:24 2022] DELETE /identity/v3/projects/2abe00d76fdf4d958fc1256c5123b069 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:24.745245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.745631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.745980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.765345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:24.766963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:24.800538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:24.841518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1284/2581] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:16:24.849846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.850136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.850449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.875574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:24.877230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:24.885874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1298/2582] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:24.890376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:24.900558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004525f-a8a4-4eeb-b3cf-afb4ec5c61c5 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:24.906536 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:24.907346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.907700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.907980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.908797 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:16:24.909108 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:24.911089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:24.924541 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1285/2583] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:16:24.928925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:24.941360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aed499-7593-4a7a-8324-0d543acddfa7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:24.947993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:24.948873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:24.949162 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:24.949438 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:24.950209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:24.952254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:25.002271 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1299/2584] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:16:24 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:16:25.007124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:25.019193 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed998-376b-4370-acd6-db593b575d7e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:25.103056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:25.104595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:25.105137 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:25.105415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:25.106114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:25.108092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:25.139825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1286/2585] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:16:25 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:16:25.144676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:25.160668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f1df-09cb-4739-a8d7-4d18198a5cab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:25.169966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:25.170680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:25.170960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:25.171234 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:25.172009 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:25.174442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:25.195659 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1300/2586] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:16:25.199666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:25.212687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c1a9-7712-4029-ab73-55e9faeacca7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:25.219126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041e04-2329-4733-9e15-71a49b435248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:25.219816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041e04-2329-4733-9e15-71a49b435248 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:25.220104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041e04-2329-4733-9e15-71a49b435248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:25.220415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041e04-2329-4733-9e15-71a49b435248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:25.221168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041e04-2329-4733-9e15-71a49b435248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:25.222870 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041e04-2329-4733-9e15-71a49b435248 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:25.233863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1287/2587] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:16:25.238181 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:25.255372 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abd6dd-645e-4b12-a040-fd4f8c62248b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:25.264919 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:25.266390 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:25.266680 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:25.266987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] PATH_INFO: `/v3/projects/cf3b17c38a9c4fc0aa0082cbb88f92bd/users/6c5967ba9a064769b3c6135bd6f55338/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:25.292385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3b17c38a9c4fc0aa0082cbb88f92bd, user_id=6c5967ba9a064769b3c6135bd6f55338, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:25.295057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:25.310397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1301/2588] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:16:25 2022] PUT /identity/v3/projects/cf3b17c38a9c4fc0aa0082cbb88f92bd/users/6c5967ba9a064769b3c6135bd6f55338/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:25.316152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105eb84-13e5-4824-9a91-0ea520eb9e63 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:25.316693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105eb84-13e5-4824-9a91-0ea520eb9e63 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:25.316693 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105eb84-13e5-4824-9a91-0ea520eb9e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:25.341771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e105eb84-13e5-4824-9a91-0ea520eb9e63 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:25.344020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e105eb84-13e5-4824-9a91-0ea520eb9e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:25.419435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1288/2589] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:16:25.429104 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:25.431035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:25.501665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1b80-6c89-440a-a023-51c9e67f3397 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:25.506169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:25.506867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:25.507357 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:25.507737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:25.518608 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:25.520056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:25.531366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1302/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:16:30.484873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:30.486461 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:30.486958 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:30.531205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] MFA Rules not processed for user `6c5967ba9a064769b3c6135bd6f55338`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:30.533071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:30.617072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:30.666269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:30.669454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:30.739445 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1289/2591] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:16:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:30.804082 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:30.834147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee829a6e-cb72-40d3-b495-fd3426c7eaa5 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:30.841669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:30.843013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:30.843632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:30.844236 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:30.848439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:30.877693 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:30.881549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d9c40-ed46-4688-985b-b3781c422017 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:30.896064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1303/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:16:30.950603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:30.971775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8031f-ed11-443b-9631-b0d778c3d705 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:30.981143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:30.981816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:30.982102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:30.982448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:30.996060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:30.997746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:31.013380 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1290/2593] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:32.621147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3134-f1e3-4611-81f8-2ec31d7ea3c2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:32.621665 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3134-f1e3-4611-81f8-2ec31d7ea3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:32.621778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3134-f1e3-4611-81f8-2ec31d7ea3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:32.642058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-df6c3134-f1e3-4611-81f8-2ec31d7ea3c2 None None] MFA Rules not processed for user `6c5967ba9a064769b3c6135bd6f55338`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:32.643326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df6c3134-f1e3-4611-81f8-2ec31d7ea3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:32.657861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1304/2594] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:33.005955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:33.007534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:33.022538 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbf87a-70ea-4f76-8aa7-9d1594371453 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:33.029057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:33.029697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:33.029986 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:33.030294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:33.033547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:33.044769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:33.046207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:33.055814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1291/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:33.686409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:33.686914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:33.687712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:33.715934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:33.717228 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:33.821207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1305/2596] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 09:16:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:33.834779 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:33.836265 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:33.976755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da6f6-8750-4912-882d-c1820e40dfa4 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:33.990555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:33.991500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:33.991973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:33.997073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:34.012580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:34.014679 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:34.045030 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1292/2597] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:16:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:16:40.033926 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:40.048823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3babede-1c47-49e8-b11f-97457b5fbf21 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:40.054283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:40.055232 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:40.055969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:40.056573 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:40.058945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:40.073880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:40.075542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:40.086745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1306/2598] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:42.083304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:42.085284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:42.170127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c569b-4cd0-4654-b5e2-940b8c9b2d0a service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:42.176771 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:42.177567 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:42.177864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:42.178147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:42.180492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:42.181813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:42.184505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:42.198549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc8558-77aa-4535-a22c-7f9d2682618e service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:42.199166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:42.201076 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:42.204422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:42.205296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:42.205583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:42.205861 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] PATH_INFO: `/v3/users/071eb452502a490db98c6331099f2f7a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:42.207102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=071eb452502a490db98c6331099f2f7a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:42.209030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:42.216530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1293/2599] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:42.271169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071eb452502a490db98c6331099f2f7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.281156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071eb452502a490db98c6331099f2f7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.281889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071eb452502a490db98c6331099f2f7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.289964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071eb452502a490db98c6331099f2f7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.290690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071eb452502a490db98c6331099f2f7a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.309028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1307/2600] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:16:42 2022] DELETE /identity/v3/users/071eb452502a490db98c6331099f2f7a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:16:42.521731 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:42.533648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4b677-4a03-497d-bb19-116db9af8288 service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:42.550490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:42.604561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:42.605441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:42.605723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:42.606022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] PATH_INFO: `/v3/projects/4b08481785fa47dbb5275dde5571213f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:42.607270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b08481785fa47dbb5275dde5571213f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:42.609982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:42.666970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b08481785fa47dbb5275dde5571213f', 'request_id': 'req-17ac6b84-d57b-4e6e-97b9-d982bffe0993'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.673299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b08481785fa47dbb5275dde5571213f', 'request_id': 'req-17ac6b84-d57b-4e6e-97b9-d982bffe0993'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.679967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b08481785fa47dbb5275dde5571213f', 'request_id': 'req-17ac6b84-d57b-4e6e-97b9-d982bffe0993'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.692463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] The token cache is being invalidate because project 4b08481785fa47dbb5275dde5571213f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:16:42.692762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.693384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.694961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1294/2601] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:16:42 2022] DELETE /identity/v3/projects/4b08481785fa47dbb5275dde5571213f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:42.699178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:42.700446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:42.713416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b308f57-cbb6-4f88-971c-56a85901a4cb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:42.752711 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:42.773107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:42.773909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:42.774188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:42.774492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] PATH_INFO: `/v3/users/451775199ac7461ca925dd4cd4a56286` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:42.775666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451775199ac7461ca925dd4cd4a56286)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:42.777568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:42.823743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451775199ac7461ca925dd4cd4a56286'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.830697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451775199ac7461ca925dd4cd4a56286'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.831360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451775199ac7461ca925dd4cd4a56286'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.838299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451775199ac7461ca925dd4cd4a56286'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.838921 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dca49dab-9bb1-46b6-9b0a-596124d2d2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451775199ac7461ca925dd4cd4a56286'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:42.857188 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1308/2602] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:16:42 2022] DELETE /identity/v3/users/451775199ac7461ca925dd4cd4a56286 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:43.029952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:43.032590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:43.044591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac6b84-d57b-4e6e-97b9-d982bffe0993 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:43.102370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:43.103306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:43.103591 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:43.103866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] PATH_INFO: `/v3/projects/bc3c68447354406b910a024f1d6066a1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:43.105055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3c68447354406b910a024f1d6066a1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:43.107033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:43.153651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3c68447354406b910a024f1d6066a1', 'request_id': 'req-97997d8b-ae8d-4783-be04-d3f8f58f6947'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:43.154845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:43.161254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3c68447354406b910a024f1d6066a1', 'request_id': 'req-97997d8b-ae8d-4783-be04-d3f8f58f6947'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:43.169156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3c68447354406b910a024f1d6066a1', 'request_id': 'req-97997d8b-ae8d-4783-be04-d3f8f58f6947'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:43.181611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] The token cache is being invalidate because project bc3c68447354406b910a024f1d6066a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:16:43.181907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:43.182539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:43.184080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1295/2603] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:16:43 2022] DELETE /identity/v3/projects/bc3c68447354406b910a024f1d6066a1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:46.127302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:46.127767 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:46.127858 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:46.145734 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:16:46.147115 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:46.207948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1309/2604] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 09:16:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:16:46.220417 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:46.221810 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:46.293399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97997d8b-ae8d-4783-be04-d3f8f58f6947 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:46.298919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:46.299560 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:46.299840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:46.300115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:46.308437 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:46.310012 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:46.318040 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1296/2605] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 09:16:53.174138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:53.175626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:53.242123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca31904-c031-4f3b-83e3-ce8aea6348bb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:53.246666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:53.247518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:53.247804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:53.248081 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] PATH_INFO: `/v3/users/c91cd3519ed44653ac365c22431634e7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:53.249790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91cd3519ed44653ac365c22431634e7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:53.251853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:53.256789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:53.299511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91cd3519ed44653ac365c22431634e7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.306576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91cd3519ed44653ac365c22431634e7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.307241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91cd3519ed44653ac365c22431634e7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.316166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91cd3519ed44653ac365c22431634e7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.316852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91cd3519ed44653ac365c22431634e7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.335006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1310/2606] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:16:53 2022] DELETE /identity/v3/users/c91cd3519ed44653ac365c22431634e7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:53.506128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:53.517026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee90ac-a954-4ee7-aec2-b677e410c1e6 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:53.576742 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:53.577543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:53.577829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:53.578103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] PATH_INFO: `/v3/projects/df10fec88e014e1fa24fa9b09a09f477` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:53.579463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df10fec88e014e1fa24fa9b09a09f477)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:53.581338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:53.627083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df10fec88e014e1fa24fa9b09a09f477', 'request_id': 'req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.632787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df10fec88e014e1fa24fa9b09a09f477', 'request_id': 'req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.638829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df10fec88e014e1fa24fa9b09a09f477', 'request_id': 'req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.646844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:53.652085 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] The token cache is being invalidate because project df10fec88e014e1fa24fa9b09a09f477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:16:53.652582 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.653791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.655484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1297/2607] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:16:53 2022] DELETE /identity/v3/projects/df10fec88e014e1fa24fa9b09a09f477 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:53.659892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:53.661291 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:53.675001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d6d7-50e9-435b-b56d-c45f3f360fc2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:53.731306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:53.732182 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:53.732470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:53.732752 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] PATH_INFO: `/v3/users/d699fe926d6f4c05aa511d8c7628f074` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:53.734536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d699fe926d6f4c05aa511d8c7628f074)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:53.736482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:53.782056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd699fe926d6f4c05aa511d8c7628f074'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.789179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd699fe926d6f4c05aa511d8c7628f074'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.789846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd699fe926d6f4c05aa511d8c7628f074'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.797678 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd699fe926d6f4c05aa511d8c7628f074'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.798319 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9a01d7-4d41-4884-9b10-42c7dcae0ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd699fe926d6f4c05aa511d8c7628f074'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:53.815329 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1311/2608] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:16:53 2022] DELETE /identity/v3/users/d699fe926d6f4c05aa511d8c7628f074 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:16:53.979793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:53.981252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:53.995226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9a1a0-6aa0-42dc-bc02-0d32f5a6d611 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:54.052814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:54.053682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:54.053967 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:54.054269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] PATH_INFO: `/v3/projects/326346664d0642bd8f7bcee9c9ca3f14` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:54.055451 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326346664d0642bd8f7bcee9c9ca3f14)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:54.057344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:54.102049 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326346664d0642bd8f7bcee9c9ca3f14', 'request_id': 'req-6cbf93c5-ee18-4608-8133-8e7469f52d99'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:54.107449 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326346664d0642bd8f7bcee9c9ca3f14', 'request_id': 'req-6cbf93c5-ee18-4608-8133-8e7469f52d99'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:54.114178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326346664d0642bd8f7bcee9c9ca3f14', 'request_id': 'req-6cbf93c5-ee18-4608-8133-8e7469f52d99'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:54.125980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] The token cache is being invalidate because project 326346664d0642bd8f7bcee9c9ca3f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:16:54.126291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:54.126908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:16:54.128424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1298/2609] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:16:53 2022] DELETE /identity/v3/projects/326346664d0642bd8f7bcee9c9ca3f14 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:17:03.811807 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:04.123020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:16.357429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf2b4-b820-4b53-b9c6-7c412055543e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:16.357878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf2b4-b820-4b53-b9c6-7c412055543e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:16.357974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf2b4-b820-4b53-b9c6-7c412055543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:16.375933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-219cf2b4-b820-4b53-b9c6-7c412055543e None None] MFA Rules not processed for user `3d5dbf6f382f4ec1a174f961c7ffb2a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:17:16.377127 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-219cf2b4-b820-4b53-b9c6-7c412055543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:16.432440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1312/2610] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:17:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:17:16.725025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:16.726491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:16.783014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf93c5-ee18-4608-8133-8e7469f52d99 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:16.786676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:16.787377 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:16.787692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:16.787974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:16.789791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:16.799215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:16.800666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:16.808559 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1299/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:17:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:17:26.426267 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=25 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:26.805039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=26 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:26.940212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82fbd4-dca3-478b-bcf5-709af778092e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:26.940506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82fbd4-dca3-478b-bcf5-709af778092e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:26.940806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82fbd4-dca3-478b-bcf5-709af778092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:26.958086 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2b82fbd4-dca3-478b-bcf5-709af778092e None None] MFA Rules not processed for user `6c5967ba9a064769b3c6135bd6f55338`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:17:26.959312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2b82fbd4-dca3-478b-bcf5-709af778092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:27.012976 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1313/2612] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:17:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:17:37.006501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=25 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:06.081665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:06.083096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:06.151523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99100da-c283-4846-8f39-87073048f6a9 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:06.156544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:06.157208 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:06.157492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:06.157769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:06.159584 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:06.171038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:06.172631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:06.183072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1300/2613] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:18:16.178872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=32 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:23.150697 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5e7b9-8033-4975-901d-8c929a8c1930 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:23.151196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5e7b9-8033-4975-901d-8c929a8c1930 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:23.151303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5e7b9-8033-4975-901d-8c929a8c1930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:23.172251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6fb5e7b9-8033-4975-901d-8c929a8c1930 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:23.173580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6fb5e7b9-8033-4975-901d-8c929a8c1930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:23.233338 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1314/2614] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:18:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:18:23.281188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:23.282656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:23.358876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bdc47-62d5-4f1c-9c3a-aa70bef5fdb6 service placement] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:23.363952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778931da-8967-4a24-8cfa-9aa990a4671a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:23.364658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778931da-8967-4a24-8cfa-9aa990a4671a service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:23.365009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778931da-8967-4a24-8cfa-9aa990a4671a service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:23.365249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778931da-8967-4a24-8cfa-9aa990a4671a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:23.373578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778931da-8967-4a24-8cfa-9aa990a4671a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:23.375185 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778931da-8967-4a24-8cfa-9aa990a4671a service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:23.383839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1301/2615] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:18:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:18:27.426699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8264-e6ec-449f-b6e2-50a3148b2d7f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:27.427222 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8264-e6ec-449f-b6e2-50a3148b2d7f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:27.427328 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8264-e6ec-449f-b6e2-50a3148b2d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:27.449368 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b28a8264-e6ec-449f-b6e2-50a3148b2d7f None None] MFA Rules not processed for user `6c5967ba9a064769b3c6135bd6f55338`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:27.450759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b28a8264-e6ec-449f-b6e2-50a3148b2d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:27.459153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1315/2616] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:18:33.380124 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=32 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:37.445587 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=28 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:37.979384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a52a8-8e9f-4c33-9a81-4f8d6afaba5d None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:37.979961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a52a8-8e9f-4c33-9a81-4f8d6afaba5d None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:37.979961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a52a8-8e9f-4c33-9a81-4f8d6afaba5d None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:37.981345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1302/2617] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:18:37.987034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16564-5a9e-4817-81b2-d38982d979fb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:37.987321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16564-5a9e-4817-81b2-d38982d979fb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:37.987597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16564-5a9e-4817-81b2-d38982d979fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.006394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-54d16564-5a9e-4817-81b2-d38982d979fb None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:38.007732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-54d16564-5a9e-4817-81b2-d38982d979fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:38.080992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1316/2618] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:18:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:18:38.093659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a52a8-8e9f-4c33-9a81-4f8d6afaba5d None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:38.096028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-519a52a8-8e9f-4c33-9a81-4f8d6afaba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:38.156202 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a52a8-8e9f-4c33-9a81-4f8d6afaba5d None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:38.159768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d20b1-9d3c-4544-b961-3efd986c51d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0713044ffd0247fe8a983d3d1ee15a6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:38.160410 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d20b1-9d3c-4544-b961-3efd986c51d9 service glance] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.160692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d20b1-9d3c-4544-b961-3efd986c51d9 service glance] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.160965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d20b1-9d3c-4544-b961-3efd986c51d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.172272 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d20b1-9d3c-4544-b961-3efd986c51d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:38.173763 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d20b1-9d3c-4544-b961-3efd986c51d9 service glance] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:38.185280 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1303/2619] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:18:38.252916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd7ed-4c3c-4780-a2d2-bf7e1c11d426 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.253201 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd7ed-4c3c-4780-a2d2-bf7e1c11d426 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.253506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd7ed-4c3c-4780-a2d2-bf7e1c11d426 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.254920 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1317/2620] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:18:38.260051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aedf24-3eea-40b4-80cd-2644cf15cbdb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.260360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aedf24-3eea-40b4-80cd-2644cf15cbdb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.260662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aedf24-3eea-40b4-80cd-2644cf15cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.280289 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-37aedf24-3eea-40b4-80cd-2644cf15cbdb None None] MFA Rules not processed for user `4ec4a5d37c914c5e8296aa9e14c9c3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:38.281487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-37aedf24-3eea-40b4-80cd-2644cf15cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:38.288043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1304/2621] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:18:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:18:38.299893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd7ed-4c3c-4780-a2d2-bf7e1c11d426 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:38.310982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd7ed-4c3c-4780-a2d2-bf7e1c11d426 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:38.315616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479cce-28d4-4e0c-9d24-5ff1ccd08d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:38.315825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479cce-28d4-4e0c-9d24-5ff1ccd08d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.316076 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479cce-28d4-4e0c-9d24-5ff1ccd08d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.316456 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479cce-28d4-4e0c-9d24-5ff1ccd08d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.323482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479cce-28d4-4e0c-9d24-5ff1ccd08d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:38.324891 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479cce-28d4-4e0c-9d24-5ff1ccd08d42 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:38.332640 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1318/2622] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:18:38.413029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe3e48-c6d5-4fbb-a929-17d09c2ca133 None None] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.413317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe3e48-c6d5-4fbb-a929-17d09c2ca133 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.413596 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe3e48-c6d5-4fbb-a929-17d09c2ca133 None None] PATH_INFO: `/` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.415026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1305/2623] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jun 24 09:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:18:38.420385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64355d65-e063-4bec-928d-d14fca27ba7f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.420671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64355d65-e063-4bec-928d-d14fca27ba7f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.420947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64355d65-e063-4bec-928d-d14fca27ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.439204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-64355d65-e063-4bec-928d-d14fca27ba7f None None] MFA Rules not processed for user `572e1cbd83cb43c396cd474079633af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:38.440460 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64355d65-e063-4bec-928d-d14fca27ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:38.450190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1319/2624] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jun 24 09:18:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:18:38.460392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe3e48-c6d5-4fbb-a929-17d09c2ca133 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:38.471403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe3e48-c6d5-4fbb-a929-17d09c2ca133 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:38.474953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:38.475577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:38.475859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:38.476130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:38.486888 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:38.488296 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:38.498819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1306/2625] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:18:40.085130 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c542d5-6dc1-4d37-b662-9a47f32713b3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:40.085623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c542d5-6dc1-4d37-b662-9a47f32713b3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:40.085749 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c542d5-6dc1-4d37-b662-9a47f32713b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:40.110720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-78c542d5-6dc1-4d37-b662-9a47f32713b3 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:40.112084 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78c542d5-6dc1-4d37-b662-9a47f32713b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:40.120121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1320/2626] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:18:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:18:40.132364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:40.144438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4702e66-5b0a-469a-bb50-2416a92589d7 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:40.149473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:40.150115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:40.150440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:40.150769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:40.159987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:40.161507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:40.171381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1307/2627] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:18:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:18:50.105177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=43 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:50.167595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=41 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:53.861414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd17df-c92f-4777-a7f5-36a0af0348ee None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:53.861903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd17df-c92f-4777-a7f5-36a0af0348ee None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:53.862134 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd17df-c92f-4777-a7f5-36a0af0348ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:53.879717 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e3cd17df-c92f-4777-a7f5-36a0af0348ee None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:18:53.880917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e3cd17df-c92f-4777-a7f5-36a0af0348ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:53.888305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1321/2628] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 09:18:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:18:53.900796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:53.911291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb729ee-5aee-4bd3-9899-66a89f06a276 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:53.916240 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:53.916867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:53.917154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:53.917432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:53.925452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:53.927054 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:53.935050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1308/2629] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:19:03.874198 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:03.931774 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:26.338638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:26.339226 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:26.339332 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:26.357781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] MFA Rules not processed for user `6c5967ba9a064769b3c6135bd6f55338`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:26.359030 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:26.366682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1322/2630] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:33.316513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:33.317912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:33.396170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3fc56-036e-4d2d-89bd-e69be4831d2c service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:33.399787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:33.400425 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:33.400707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:33.400985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:33.402777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:33.414058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:33.415494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:33.424271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1309/2631] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:36.352625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:40.353830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:40.355374 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:40.367642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633abd4-1c7e-428b-901a-6ecbc4296241 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:40.371220 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:40.371855 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:40.372139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:40.372415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:40.374098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:40.435187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:40.436596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:40.446577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1323/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:43.420225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=35 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:43.484625 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:43.486117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:43.501235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edfb92-9bc4-4889-a972-458a24eec377 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:43.506266 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:43.507413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:43.507692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:43.507960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] PATH_INFO: `/v3/users/3d5dbf6f382f4ec1a174f961c7ffb2a1` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:43.509136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5dbf6f382f4ec1a174f961c7ffb2a1)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:43.511081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:43.557203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5dbf6f382f4ec1a174f961c7ffb2a1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.563981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5dbf6f382f4ec1a174f961c7ffb2a1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.564638 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5dbf6f382f4ec1a174f961c7ffb2a1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.565751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5dbf6f382f4ec1a174f961c7ffb2a1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.577698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-14b4751f-b188-4eba-9f6e-e050956b234b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5dbf6f382f4ec1a174f961c7ffb2a1'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.591292 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1310/2633] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:43 2022] DELETE /identity/v3/users/3d5dbf6f382f4ec1a174f961c7ffb2a1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:43.760071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:43.772067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c89d7-42a7-424d-9762-63a209659c41 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:43.828768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:43.829616 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:43.829899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:43.830175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] PATH_INFO: `/v3/projects/312a47e3783b4ffc84c1f04851504a9d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:43.832045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=312a47e3783b4ffc84c1f04851504a9d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:43.833931 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:43.879314 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312a47e3783b4ffc84c1f04851504a9d', 'request_id': 'req-c9a818a7-6505-4e37-85ed-9e45501cc956'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.884922 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312a47e3783b4ffc84c1f04851504a9d', 'request_id': 'req-c9a818a7-6505-4e37-85ed-9e45501cc956'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.890899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312a47e3783b4ffc84c1f04851504a9d', 'request_id': 'req-c9a818a7-6505-4e37-85ed-9e45501cc956'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.903637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] The token cache is being invalidate because project 312a47e3783b4ffc84c1f04851504a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:43.903929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.904574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c9a818a7-6505-4e37-85ed-9e45501cc956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:43.906101 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1324/2634] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:43 2022] DELETE /identity/v3/projects/312a47e3783b4ffc84c1f04851504a9d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:43.910933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:43.911225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:43.911506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:43.929725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:43.930969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:43.988593 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1311/2635] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:43.996289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:43.996580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:43.996859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.015966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:44.017207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:44.025412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1325/2636] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:44.029670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.039469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4fb91-9874-4d43-893c-11fb5454a4ec None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.044043 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.044692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.044977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.045257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.045990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:19:44.046328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.047924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.059814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1312/2637] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:19:44.064037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.073898 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fcf48-b1ff-41c5-b158-46c17ce4d02a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.078526 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.079172 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.079454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.079732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.080429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.082334 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.095740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:44.108489 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1326/2638] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:44 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:44.113147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.123299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb6e9f-dede-469a-8eac-f3d15aba1a22 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.179260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.179879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.180161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.180436 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.181213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.183154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.189551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:44.204154 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1313/2639] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:44 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:44.208177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.218398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e8320-be0f-4105-9b4e-bedf515641b6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.223012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.223667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.223951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.224226 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.224953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.226572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.236732 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1327/2640] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:44.240922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.250776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adc0d3-ed58-4814-b863-b2b3baaf85ef admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.256020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f074e9-c456-44a4-8e82-14218a52ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.256671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f074e9-c456-44a4-8e82-14218a52ccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.257214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f074e9-c456-44a4-8e82-14218a52ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.257499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f074e9-c456-44a4-8e82-14218a52ccb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.258245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f074e9-c456-44a4-8e82-14218a52ccb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.259841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f074e9-c456-44a4-8e82-14218a52ccb3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.269619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1314/2641] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:44.273391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.283219 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede6af-c262-4242-81a2-e880118e2aa0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.288336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.289204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.289490 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.289763 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] PATH_INFO: `/v3/projects/ab7884a9ef0d4e6aa47bb1f27f4e994d/users/a377433b02fa44acb2a8ff561d86e020/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.304622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7884a9ef0d4e6aa47bb1f27f4e994d, user_id=a377433b02fa44acb2a8ff561d86e020, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.307288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.320060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1328/2642] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:44 2022] PUT /identity/v3/projects/ab7884a9ef0d4e6aa47bb1f27f4e994d/users/a377433b02fa44acb2a8ff561d86e020/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:19:44.330303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.330599 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.330885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.357276 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] MFA Rules not processed for user `a377433b02fa44acb2a8ff561d86e020`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:44.358531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:44.423094 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1315/2643] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:44.428155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.489031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0b7e3-bf46-4829-9cc9-e5e11035a889 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.493647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.494330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.494621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.494901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.495631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.497527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.528112 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1329/2644] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:44 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:44.529228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.540547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd269-707a-4ff3-a3a3-a9b19056e610 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.600730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.601668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.601976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.607140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.607140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.607140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.631506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1316/2645] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:44 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:44.635539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.646603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48d01a-b941-4551-9834-687c030b5202 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.651238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.651893 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.652179 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.652459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.653190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.655103 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.667105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1330/2646] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:44.671130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.680955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fa72b-679b-4e5e-9b3b-c24070bf72f2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.685609 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.686509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.686791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.687073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] PATH_INFO: `/v3/projects/b4aa3a2848a64b5390aefbca83e17f49/users/1822c8a7971b46daa712113dfc3d1388/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.701674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aa3a2848a64b5390aefbca83e17f49, user_id=1822c8a7971b46daa712113dfc3d1388, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.704368 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.717765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1317/2647] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:44 2022] PUT /identity/v3/projects/b4aa3a2848a64b5390aefbca83e17f49/users/1822c8a7971b46daa712113dfc3d1388/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:19:44.722157 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.732176 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793af181-2b9a-4a2d-a23d-934e6786a8ff admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.788022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28687e1d-8d78-46f7-aba3-2e9dddbfcb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.788661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28687e1d-8d78-46f7-aba3-2e9dddbfcb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.788863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28687e1d-8d78-46f7-aba3-2e9dddbfcb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.789140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28687e1d-8d78-46f7-aba3-2e9dddbfcb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.789870 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28687e1d-8d78-46f7-aba3-2e9dddbfcb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.791503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28687e1d-8d78-46f7-aba3-2e9dddbfcb28 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.801196 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1331/2648] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:44.805357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.815521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ce68-aa79-4e88-87be-5ccd2726e31d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:44.820117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:44.820981 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.821267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.821539 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] PATH_INFO: `/v3/projects/b4aa3a2848a64b5390aefbca83e17f49/users/1822c8a7971b46daa712113dfc3d1388/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.823503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4aa3a2848a64b5390aefbca83e17f49, user_id=1822c8a7971b46daa712113dfc3d1388, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:44.826143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:44.836605 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1318/2649] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:44 2022] PUT /identity/v3/projects/b4aa3a2848a64b5390aefbca83e17f49/users/1822c8a7971b46daa712113dfc3d1388/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:44.848415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:44.848707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:44.848987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:44.874889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] MFA Rules not processed for user `1822c8a7971b46daa712113dfc3d1388`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:44.876099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:44.895316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:44.945333 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1332/2650] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:19:44.956854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:44.958551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:44.980969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:45.015669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3afeb5-886d-48e0-843c-9550ec91f4b1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:45.019906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2ea94-66cf-44f1-94fe-bab043019e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:45.020545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ea94-66cf-44f1-94fe-bab043019e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:45.020823 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ea94-66cf-44f1-94fe-bab043019e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:45.021096 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2ea94-66cf-44f1-94fe-bab043019e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:45.030476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ea94-66cf-44f1-94fe-bab043019e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:45.031785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2ea94-66cf-44f1-94fe-bab043019e77 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:45.041153 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1319/2651] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:45.425278 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:45.486602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f06fa-92d7-47ee-9380-f208f5c6f9ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:45.491617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:45.492479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:45.492760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:45.493036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] PATH_INFO: `/v3/users/a377433b02fa44acb2a8ff561d86e020` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:45.494237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a377433b02fa44acb2a8ff561d86e020)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:45.496218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:45.541187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a377433b02fa44acb2a8ff561d86e020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:45.548159 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a377433b02fa44acb2a8ff561d86e020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:45.548781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a377433b02fa44acb2a8ff561d86e020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:45.555974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a377433b02fa44acb2a8ff561d86e020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:45.556606 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a377433b02fa44acb2a8ff561d86e020'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:45.574161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1333/2652] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:45 2022] DELETE /identity/v3/users/a377433b02fa44acb2a8ff561d86e020 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:45.578701 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:45.579206 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:45.579304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:45.597418 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:45.598656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:45.659420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1320/2653] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:45.669097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:45.670511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:45.710874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:45.730038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f7ee5-7e09-4c51-ae23-49f1629ed497 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:45.733735 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:45.734435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:45.734721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:45.734999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:45.744552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:45.745964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:45.755935 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1334/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:46.018125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:46.021941 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:46.034927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a3e71-6c69-49f3-a464-bfee64fd7547 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:46.039621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:46.040468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.040821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.041034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] PATH_INFO: `/v3/projects/ab7884a9ef0d4e6aa47bb1f27f4e994d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.042171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7884a9ef0d4e6aa47bb1f27f4e994d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:46.044125 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:46.090855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7884a9ef0d4e6aa47bb1f27f4e994d', 'request_id': 'req-eecf9d53-6b6c-45a4-9b97-153cb757e03e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.096770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7884a9ef0d4e6aa47bb1f27f4e994d', 'request_id': 'req-eecf9d53-6b6c-45a4-9b97-153cb757e03e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.102822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7884a9ef0d4e6aa47bb1f27f4e994d', 'request_id': 'req-eecf9d53-6b6c-45a4-9b97-153cb757e03e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.115985 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] The token cache is being invalidate because project ab7884a9ef0d4e6aa47bb1f27f4e994d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:46.116269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.116893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.118407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1321/2655] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:46 2022] DELETE /identity/v3/projects/ab7884a9ef0d4e6aa47bb1f27f4e994d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:46.122396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:46.132266 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0154d-814e-44f8-809d-80098a4fb549 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:46.188069 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:46.188933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.189240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.189518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] PATH_INFO: `/v3/users/1822c8a7971b46daa712113dfc3d1388` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.190853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1822c8a7971b46daa712113dfc3d1388)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:46.192747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:46.237657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1822c8a7971b46daa712113dfc3d1388'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.244441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1822c8a7971b46daa712113dfc3d1388'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.245097 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1822c8a7971b46daa712113dfc3d1388'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.252354 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1822c8a7971b46daa712113dfc3d1388'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.253613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b9ee66b7-7994-4a07-865f-1e8cf011b579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1822c8a7971b46daa712113dfc3d1388'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.270907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1335/2656] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:46 2022] DELETE /identity/v3/users/1822c8a7971b46daa712113dfc3d1388 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:46.536010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:46.537443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:46.552374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf9d53-6b6c-45a4-9b97-153cb757e03e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:46.597629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:46.612928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:46.613868 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.614090 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.614416 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] PATH_INFO: `/v3/projects/b4aa3a2848a64b5390aefbca83e17f49` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.615587 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4aa3a2848a64b5390aefbca83e17f49)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:46.617475 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:46.662399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4aa3a2848a64b5390aefbca83e17f49', 'request_id': 'req-e99682ce-c9c2-4e9c-887a-9674ad96db35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.667855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4aa3a2848a64b5390aefbca83e17f49', 'request_id': 'req-e99682ce-c9c2-4e9c-887a-9674ad96db35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.674309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4aa3a2848a64b5390aefbca83e17f49', 'request_id': 'req-e99682ce-c9c2-4e9c-887a-9674ad96db35'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.686529 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] The token cache is being invalidate because project b4aa3a2848a64b5390aefbca83e17f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:46.686816 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.687435 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e99682ce-c9c2-4e9c-887a-9674ad96db35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:46.688961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1322/2657] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:46 2022] DELETE /identity/v3/projects/b4aa3a2848a64b5390aefbca83e17f49 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:46.693828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.694121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.694429 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.711984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:46.713178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:46.761843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:46.772802 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1336/2658] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:46.780640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5084-0198-468e-b3fe-001988305b1a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.780965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5084-0198-468e-b3fe-001988305b1a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.781267 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e5084-0198-468e-b3fe-001988305b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.800261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-497e5084-0198-468e-b3fe-001988305b1a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:46.801454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-497e5084-0198-468e-b3fe-001988305b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:46.809648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1323/2659] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:46.813620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:46.823155 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1407b-b5e1-48fb-b93a-8bd47515f585 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:46.827672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:46.828321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.828604 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.828880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.829603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:19:46.829911 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:46.831560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:46.842799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1337/2660] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:19:46.847361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e5084-0198-468e-b3fe-001988305b1a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:46.856622 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e5084-0198-468e-b3fe-001988305b1a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:46.862630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:46.863423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.863709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.864039 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.864692 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:46.866614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:46.894834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1324/2661] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:46 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:46.896191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:46.906021 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b73fed-e1dd-44b2-952a-bc47fb30056d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:46.961585 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:46.962265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:46.962554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:46.962853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:46.963546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:46.965455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:46.985944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1338/2662] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:46 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:46.990132 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.000282 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1210-acba-4895-a5e9-b96055e5a3a8 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.004873 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.005520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.005827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.006103 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.006863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.008709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.019347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1325/2663] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:47.023305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.033653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948c64e-1f4b-4c7a-8758-fc5bc0844a5a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.038860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2397c-67e9-4382-9fef-c14e07803d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.039520 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2397c-67e9-4382-9fef-c14e07803d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.039788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2397c-67e9-4382-9fef-c14e07803d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.040062 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2397c-67e9-4382-9fef-c14e07803d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.040789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2397c-67e9-4382-9fef-c14e07803d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.042428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2397c-67e9-4382-9fef-c14e07803d0b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.053961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1339/2664] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:19:47.058078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.067978 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779ce3d-9494-4c76-97bf-d30a6536452a admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.072849 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.073904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.074186 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.074493 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] PATH_INFO: `/v3/projects/c0264a87ca0a405889b64eda41f3bafc/users/a728311da04e47d19bd0cd7e9b11f2f4/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.089429 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0264a87ca0a405889b64eda41f3bafc, user_id=a728311da04e47d19bd0cd7e9b11f2f4, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.092095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.104829 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1326/2665] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:47 2022] PUT /identity/v3/projects/c0264a87ca0a405889b64eda41f3bafc/users/a728311da04e47d19bd0cd7e9b11f2f4/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:47.116058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.116287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.116563 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.141954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] MFA Rules not processed for user `a728311da04e47d19bd0cd7e9b11f2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:47.143699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:47.206639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1340/2666] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:47.211115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.271166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da7ec1-7c00-492e-bfb6-297489945709 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.275860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.276502 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.276791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.277065 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.277750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.279668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.297402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:47.305840 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1327/2667] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:47 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:47.309543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.320969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a584-f8a3-4eec-9ed0-c39dce119cf2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.366649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:47.376416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.377075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.377883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.378167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.378894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.380804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.400396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1341/2668] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:47 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:47.404370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.414694 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f000-bad6-4e39-b294-f0cfa0c62860 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.419902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.420566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.420847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.421120 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.421847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.423469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.434047 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1328/2669] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:47.438072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.448478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eec006-bf16-4ea0-9709-2f8394394143 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.453065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.453925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.454206 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.454512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] PATH_INFO: `/v3/projects/8c43f226c43f4206b93687d6c45aa933/users/0707b85f94e04382ab4aeafa01decb3d/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.469389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c43f226c43f4206b93687d6c45aa933, user_id=0707b85f94e04382ab4aeafa01decb3d, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.472066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.484580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1342/2670] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:47 2022] PUT /identity/v3/projects/8c43f226c43f4206b93687d6c45aa933/users/0707b85f94e04382ab4aeafa01decb3d/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:47.488358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.498299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b10d53-67a5-423e-bc2d-2de9801af457 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.554373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be2d7-980e-4318-b988-aa122db1d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.555035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be2d7-980e-4318-b988-aa122db1d811 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.555321 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be2d7-980e-4318-b988-aa122db1d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.555598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be2d7-980e-4318-b988-aa122db1d811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.556322 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be2d7-980e-4318-b988-aa122db1d811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.557910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be2d7-980e-4318-b988-aa122db1d811 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.567997 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1329/2671] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:47.571986 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.582808 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957bf97-7e77-440e-a036-ade861ce0bad admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.587360 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.588224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.588578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.588874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] PATH_INFO: `/v3/projects/8c43f226c43f4206b93687d6c45aa933/users/0707b85f94e04382ab4aeafa01decb3d/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.590915 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c43f226c43f4206b93687d6c45aa933, user_id=0707b85f94e04382ab4aeafa01decb3d, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.593531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.603779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1343/2672] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:47 2022] PUT /identity/v3/projects/8c43f226c43f4206b93687d6c45aa933/users/0707b85f94e04382ab4aeafa01decb3d/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:47.614196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.614725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.614850 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.641183 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] MFA Rules not processed for user `0707b85f94e04382ab4aeafa01decb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:47.642342 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:47.711100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1330/2673] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:47.722330 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.724045 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:47.781927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7f8a-6e04-4546-8335-01bf9b88e187 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.785576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.786239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.786544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.786822 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.795736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.797153 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.807011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1344/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:47.875399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:47.886189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155be59-1748-48f5-94f7-2408a33cc127 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:47.889841 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca7265-513d-49cd-a83d-9d34f5bb3490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:47.890506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca7265-513d-49cd-a83d-9d34f5bb3490 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:47.890794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca7265-513d-49cd-a83d-9d34f5bb3490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:47.891069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca7265-513d-49cd-a83d-9d34f5bb3490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:47.946597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca7265-513d-49cd-a83d-9d34f5bb3490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:47.947949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca7265-513d-49cd-a83d-9d34f5bb3490 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:47.956874 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1331/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:47 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:53.789916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:53.850702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d9515-681e-46aa-91bc-73d0cf8bb73b service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:53.855292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:53.856147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:53.856424 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:53.856694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] PATH_INFO: `/v3/users/a728311da04e47d19bd0cd7e9b11f2f4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:53.857857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a728311da04e47d19bd0cd7e9b11f2f4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:53.859917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:53.905178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a728311da04e47d19bd0cd7e9b11f2f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:53.907136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:53.913800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a728311da04e47d19bd0cd7e9b11f2f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:53.914878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a728311da04e47d19bd0cd7e9b11f2f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:53.921946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a728311da04e47d19bd0cd7e9b11f2f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:53.922663 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a728311da04e47d19bd0cd7e9b11f2f4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:53.939783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1345/2676] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:53 2022] DELETE /identity/v3/users/a728311da04e47d19bd0cd7e9b11f2f4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:53.944167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:53.944640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:53.944750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:53.956902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:53.963034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:53.964231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:54.023188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1332/2677] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:54.032729 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:54.034742 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:54.090690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c97da2-a078-45cf-9662-32f267ffadfb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:54.094320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:54.094963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:54.095239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:54.095512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:54.105341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:54.106781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:54.116790 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1346/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:54.378971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:54.380608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:54.395050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df942328-68ef-4bb1-9ec6-4a1293c6c4d7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:54.399666 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:54.400537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:54.400820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:54.401127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] PATH_INFO: `/v3/projects/c0264a87ca0a405889b64eda41f3bafc` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:54.402385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0264a87ca0a405889b64eda41f3bafc)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:54.404304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:54.450029 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0264a87ca0a405889b64eda41f3bafc', 'request_id': 'req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.455839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0264a87ca0a405889b64eda41f3bafc', 'request_id': 'req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.461856 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0264a87ca0a405889b64eda41f3bafc', 'request_id': 'req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.474775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] The token cache is being invalidate because project c0264a87ca0a405889b64eda41f3bafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:54.475060 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.475673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.477176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1333/2679] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:54 2022] DELETE /identity/v3/projects/c0264a87ca0a405889b64eda41f3bafc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:54.481528 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:54.491191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ed9c5-e6b7-403a-931c-a3628365ab6c service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:54.546469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:54.547366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:54.547648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:54.547923 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] PATH_INFO: `/v3/users/0707b85f94e04382ab4aeafa01decb3d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:54.549107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0707b85f94e04382ab4aeafa01decb3d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:54.551044 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:54.595391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0707b85f94e04382ab4aeafa01decb3d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.602747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0707b85f94e04382ab4aeafa01decb3d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.603394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0707b85f94e04382ab4aeafa01decb3d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.610682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0707b85f94e04382ab4aeafa01decb3d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.611312 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7cbf3ebd-59b4-4f37-bab0-5ec96dee99b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0707b85f94e04382ab4aeafa01decb3d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:54.618428 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:54.630057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1347/2680] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:54 2022] DELETE /identity/v3/users/0707b85f94e04382ab4aeafa01decb3d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:19:54.900319 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:54.901843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:54.918033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610f6ff-8cb0-4147-a110-0d3e7ed7f397 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:54.974646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:54.975512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:54.975799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:54.976075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] PATH_INFO: `/v3/projects/8c43f226c43f4206b93687d6c45aa933` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:54.977360 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c43f226c43f4206b93687d6c45aa933)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:54.979313 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.013527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:55.027336 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c43f226c43f4206b93687d6c45aa933', 'request_id': 'req-6bc445fd-9314-43d1-9f05-fcf80330fa1d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:55.032903 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c43f226c43f4206b93687d6c45aa933', 'request_id': 'req-6bc445fd-9314-43d1-9f05-fcf80330fa1d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:55.039161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c43f226c43f4206b93687d6c45aa933', 'request_id': 'req-6bc445fd-9314-43d1-9f05-fcf80330fa1d'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:55.051130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] The token cache is being invalidate because project 8c43f226c43f4206b93687d6c45aa933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:55.051421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:55.052045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-6bc445fd-9314-43d1-9f05-fcf80330fa1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:55.053571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1334/2681] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:54 2022] DELETE /identity/v3/projects/8c43f226c43f4206b93687d6c45aa933 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:55.058733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.059217 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.059326 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.077646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:55.078874 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:55.138039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1348/2682] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:55.146473 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.146767 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.147050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.164869 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:55.166042 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:55.174721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1335/2683] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:55.178506 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.188209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e4ef-8dd7-4398-b460-e038935dd602 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.193459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.194105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.194421 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.194700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.195431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:19:55.195738 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.197325 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.208779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1349/2684] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:19:55.212787 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.221916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd27c32-8fd4-4fed-bd0e-8d9887cef3b3 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.226613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.227257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.227595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.227821 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.228549 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.230463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.255381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1336/2685] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:55.259626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.269483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379769-b027-4b44-a204-1b70b05f1451 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.325501 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.326464 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.326769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.327027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.327708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.329631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.349430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1350/2686] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:55.353576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.366239 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a89d9-ae1a-461b-bbf3-4177b6c85c47 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.370893 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.371545 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.371837 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.372119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.372843 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.374459 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.385486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1337/2687] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:55.389465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.399446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c765dd5-2050-41a4-939b-e4d0235e49ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.404118 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d98ae1-61dd-4353-83c9-2fbbfb203509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.404879 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98ae1-61dd-4353-83c9-2fbbfb203509 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.405167 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98ae1-61dd-4353-83c9-2fbbfb203509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.405445 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d98ae1-61dd-4353-83c9-2fbbfb203509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.406174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d98ae1-61dd-4353-83c9-2fbbfb203509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.407770 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d98ae1-61dd-4353-83c9-2fbbfb203509 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.417626 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1351/2688] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:55.421523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.431963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5d9f-a336-49cc-acc4-760759826ec5 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.436577 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.437442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.437725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.438002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] PATH_INFO: `/v3/projects/63657298c4fa44c1ba6227cd76aea356/users/04b9580fc7b640f791c3c73b05d4c566/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.452617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63657298c4fa44c1ba6227cd76aea356, user_id=04b9580fc7b640f791c3c73b05d4c566, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.455293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.467671 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1338/2689] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:55 2022] PUT /identity/v3/projects/63657298c4fa44c1ba6227cd76aea356/users/04b9580fc7b640f791c3c73b05d4c566/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:19:55.478718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.478956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.479242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.507549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] MFA Rules not processed for user `04b9580fc7b640f791c3c73b05d4c566`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:55.508754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:55.551743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:55.573549 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1352/2690] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:55.578161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.642158 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3e30-b930-4269-a2db-7b774936e03e admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.647136 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.647819 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.648104 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.648381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.649102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.651140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.676415 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1339/2691] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:55.680599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.691510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92108ffd-e973-4dc1-b5f7-f9be7ce08f06 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.747143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.747741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.748031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.748317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.749008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.750982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.770560 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1353/2692] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:55.774521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.785343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2f616-2a6e-49a6-a449-b94ff552acb6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.790013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.790699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.790982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.791258 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.791983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.793566 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.804551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1340/2693] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:55.808582 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.818631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48a603-0a40-429a-a6b2-eed3609e855c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.823193 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.824056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.824341 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.824617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] PATH_INFO: `/v3/projects/0cc169c747f343cc862a1af8f8abaaed/users/8dd50eeaabf04db3a4c14f1e38ad7c12/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.839322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc169c747f343cc862a1af8f8abaaed, user_id=8dd50eeaabf04db3a4c14f1e38ad7c12, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.841954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.857409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1354/2694] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:55 2022] PUT /identity/v3/projects/0cc169c747f343cc862a1af8f8abaaed/users/8dd50eeaabf04db3a4c14f1e38ad7c12/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:55.861590 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.872290 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750d5b-7f3a-4772-9b63-b82ec8b01a44 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.902419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:55.932647 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d4067-5d9f-4c18-adaf-11c776df9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.933317 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4067-5d9f-4c18-adaf-11c776df9104 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.933603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4067-5d9f-4c18-adaf-11c776df9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.933884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d4067-5d9f-4c18-adaf-11c776df9104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.934655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4067-5d9f-4c18-adaf-11c776df9104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.936249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d4067-5d9f-4c18-adaf-11c776df9104 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.945921 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1341/2695] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:19:55.949998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:55.960811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e03960-2021-4fee-8d9a-cc6a051e9a16 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:55.965440 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:55.966375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.966661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.966936 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] PATH_INFO: `/v3/projects/0cc169c747f343cc862a1af8f8abaaed/users/8dd50eeaabf04db3a4c14f1e38ad7c12/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:55.968918 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc169c747f343cc862a1af8f8abaaed, user_id=8dd50eeaabf04db3a4c14f1e38ad7c12, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:55.972283 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:55.982383 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1355/2696] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:55 2022] PUT /identity/v3/projects/0cc169c747f343cc862a1af8f8abaaed/users/8dd50eeaabf04db3a4c14f1e38ad7c12/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:55.992646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:55.993169 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:55.993281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:56.020309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] MFA Rules not processed for user `8dd50eeaabf04db3a4c14f1e38ad7c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:56.021492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:56.089163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1342/2697] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:56.101282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:56.103149 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:56.160042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7affb-304d-4a72-8769-d3bc38d69f5e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:56.163739 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e979272-afff-4931-920e-a25f2947dd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:56.164381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979272-afff-4931-920e-a25f2947dd33 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:56.164668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979272-afff-4931-920e-a25f2947dd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:56.164947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e979272-afff-4931-920e-a25f2947dd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:56.173848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e979272-afff-4931-920e-a25f2947dd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:56.175292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e979272-afff-4931-920e-a25f2947dd33 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:56.184901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1356/2698] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:56.249442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:56.311291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6cb83-e74e-49c9-91f3-fc3606146192 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:56.316050 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:56.316952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:56.317235 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:56.317509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] PATH_INFO: `/v3/users/04b9580fc7b640f791c3c73b05d4c566` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:56.318755 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b9580fc7b640f791c3c73b05d4c566)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:56.320703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:56.365399 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b9580fc7b640f791c3c73b05d4c566'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.370648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:56.372632 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b9580fc7b640f791c3c73b05d4c566'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.373550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b9580fc7b640f791c3c73b05d4c566'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.374548 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b9580fc7b640f791c3c73b05d4c566'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.387201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b9580fc7b640f791c3c73b05d4c566'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.399558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1343/2699] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:56 2022] DELETE /identity/v3/users/04b9580fc7b640f791c3c73b05d4c566 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:56.404299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10497377-63e1-4f7a-b174-5b191714caff None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:56.404592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10497377-63e1-4f7a-b174-5b191714caff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:56.404872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10497377-63e1-4f7a-b174-5b191714caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:56.422672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-10497377-63e1-4f7a-b174-5b191714caff None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:56.423862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10497377-63e1-4f7a-b174-5b191714caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:56.456789 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:56.482589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1357/2700] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:56.492728 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:56.494161 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:56.551891 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca15d-5295-4722-843f-562d4bf90c98 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:56.555586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:56.556226 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:56.556514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:56.556794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:56.565896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:56.567302 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:56.576747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1344/2701] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:56.835442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10497377-63e1-4f7a-b174-5b191714caff None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:56.836892 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10497377-63e1-4f7a-b174-5b191714caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:56.849575 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10497377-63e1-4f7a-b174-5b191714caff None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:56.854321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:56.855186 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:56.855471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:56.855751 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] PATH_INFO: `/v3/projects/63657298c4fa44c1ba6227cd76aea356` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:56.856963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=63657298c4fa44c1ba6227cd76aea356)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:56.859018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:56.905158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63657298c4fa44c1ba6227cd76aea356', 'request_id': 'req-9612481a-475b-4c67-965e-94715ca866fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.911759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63657298c4fa44c1ba6227cd76aea356', 'request_id': 'req-9612481a-475b-4c67-965e-94715ca866fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.918132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63657298c4fa44c1ba6227cd76aea356', 'request_id': 'req-9612481a-475b-4c67-965e-94715ca866fe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.931577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] The token cache is being invalidate because project 63657298c4fa44c1ba6227cd76aea356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:56.931866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.932494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:56.934005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1358/2702] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:56 2022] DELETE /identity/v3/projects/63657298c4fa44c1ba6227cd76aea356 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:56.937944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:56.947514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57b8a3-3b65-4da4-b535-b74a1b2d4b11 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.003721 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.004585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.004865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.005140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] PATH_INFO: `/v3/users/8dd50eeaabf04db3a4c14f1e38ad7c12` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.006335 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd50eeaabf04db3a4c14f1e38ad7c12)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.008497 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.052515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd50eeaabf04db3a4c14f1e38ad7c12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.059407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd50eeaabf04db3a4c14f1e38ad7c12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.060066 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd50eeaabf04db3a4c14f1e38ad7c12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.060674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd50eeaabf04db3a4c14f1e38ad7c12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.072699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-b1318bd3-e725-42e7-9b10-054b1a42b207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd50eeaabf04db3a4c14f1e38ad7c12'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.075151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:57.087764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1345/2703] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:19:56 2022] DELETE /identity/v3/users/8dd50eeaabf04db3a4c14f1e38ad7c12 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:57.358010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.359548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:57.373568 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612481a-475b-4c67-965e-94715ca866fe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.432255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.433496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.433496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.433723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] PATH_INFO: `/v3/projects/0cc169c747f343cc862a1af8f8abaaed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.434826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc169c747f343cc862a1af8f8abaaed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.436706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.481835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc169c747f343cc862a1af8f8abaaed', 'request_id': 'req-e2736df8-34f7-459a-a2fe-ee962b446583'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.487668 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc169c747f343cc862a1af8f8abaaed', 'request_id': 'req-e2736df8-34f7-459a-a2fe-ee962b446583'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.493603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc169c747f343cc862a1af8f8abaaed', 'request_id': 'req-e2736df8-34f7-459a-a2fe-ee962b446583'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.496070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:57.507637 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] The token cache is being invalidate because project 0cc169c747f343cc862a1af8f8abaaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:19:57.507951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.508600 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e2736df8-34f7-459a-a2fe-ee962b446583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:19:57.510124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1359/2704] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:19:57 2022] DELETE /identity/v3/projects/0cc169c747f343cc862a1af8f8abaaed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:57.515067 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.515358 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.515637 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.534369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:57.535553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:57.592765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1346/2705] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:57.601455 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.601682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.601962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.621311 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:57.622500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:57.632410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1360/2706] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:57.636613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.646871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47d989-b477-469f-b0cf-5f048991cc61 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.651518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.652167 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.652452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.652734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.653466 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:19:57.653780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.655412 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.667472 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1347/2707] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:19:57.671576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.680611 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2facf2-e1eb-4712-9369-b77830256a0b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.685356 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.685990 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.686298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.686574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.687265 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.689121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.713907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1361/2708] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:57 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:57.717984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.728723 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c8b33-89eb-48d3-9975-b41ca3efcc84 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.788244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.789077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.789364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.789643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.790402 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.792332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.811163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1348/2709] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:57 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:57.815743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.825881 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3438-cc09-42ed-b733-8e14b1311e56 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.831146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.831857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.832125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.832396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.833120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.834719 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.844896 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1362/2710] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:57.848980 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.859098 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e98a8-f412-453a-8f3d-b250a161120f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.864462 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670768fc-d611-4775-85f4-a33179592a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.865112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670768fc-d611-4775-85f4-a33179592a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.865397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670768fc-d611-4775-85f4-a33179592a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.865675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670768fc-d611-4775-85f4-a33179592a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.866432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670768fc-d611-4775-85f4-a33179592a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.868032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670768fc-d611-4775-85f4-a33179592a3f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.879356 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1349/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:57.883578 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:57.894083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664f54e-8c08-44e4-ba21-11f9d4721a5a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:57.899238 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:57.900140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.900423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.900700 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] PATH_INFO: `/v3/projects/92dc264d2efa4eaca34853ed9e0542ee/users/6485c410c7cf4d14890a40dec16e5189/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.915161 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92dc264d2efa4eaca34853ed9e0542ee, user_id=6485c410c7cf4d14890a40dec16e5189, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:57.917782 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:57.931003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1363/2712] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:57 2022] PUT /identity/v3/projects/92dc264d2efa4eaca34853ed9e0542ee/users/6485c410c7cf4d14890a40dec16e5189/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:57.942717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:57.943017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:57.943327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:57.970799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] MFA Rules not processed for user `6485c410c7cf4d14890a40dec16e5189`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:57.972028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:58.018838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:58.038396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1350/2713] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:58.042799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.102673 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05d110-1d85-4363-b30d-97d9841c5fd3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.107298 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.107945 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.108231 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.108511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.109253 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.111120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.136621 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1364/2714] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:19:58 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:19:58.140770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.152014 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc9c8a-6618-4779-a46c-a50fa46c3728 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.206550 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.207209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.207494 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.207769 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.208458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.210384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.229420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1351/2715] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:19:58 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:19:58.233397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.244011 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefe4d0-03d7-48cd-b86a-0e17d9d73c01 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.248551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.249199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.249480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.249758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.250511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.252137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.263230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1365/2716] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:58.267130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.277100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d80f59-ab0a-48da-9b4a-5a778363efe7 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.281727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.282631 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.282920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.283201 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] PATH_INFO: `/v3/projects/f0b55c3bb98547479d52951c2b277888/users/aa4e8495221f44b9af689bafa7bdc605/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.297467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b55c3bb98547479d52951c2b277888, user_id=aa4e8495221f44b9af689bafa7bdc605, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.300654 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.316759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1352/2717] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:58 2022] PUT /identity/v3/projects/f0b55c3bb98547479d52951c2b277888/users/aa4e8495221f44b9af689bafa7bdc605/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:58.320812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.331814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93260fde-d53d-4823-a8bc-29777bbe0a2b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.387144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df413a2-5619-4abc-a868-ce452f18b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.387853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df413a2-5619-4abc-a868-ce452f18b76d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.388336 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df413a2-5619-4abc-a868-ce452f18b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.388614 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df413a2-5619-4abc-a868-ce452f18b76d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.389337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df413a2-5619-4abc-a868-ce452f18b76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.390960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df413a2-5619-4abc-a868-ce452f18b76d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.395927 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:58.401249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1366/2718] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:19:58.405407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.415998 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c11db-2ac4-4390-bf28-3e04493f95bb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.420615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.421487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.421772 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.422051 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] PATH_INFO: `/v3/projects/f0b55c3bb98547479d52951c2b277888/users/aa4e8495221f44b9af689bafa7bdc605/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.424588 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b55c3bb98547479d52951c2b277888, user_id=aa4e8495221f44b9af689bafa7bdc605, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.427287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.437207 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1353/2719] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:19:58 2022] PUT /identity/v3/projects/f0b55c3bb98547479d52951c2b277888/users/aa4e8495221f44b9af689bafa7bdc605/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:19:58.447814 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.448105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.448385 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.473759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] MFA Rules not processed for user `aa4e8495221f44b9af689bafa7bdc605`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:19:58.474996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:58.542793 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1367/2720] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:19:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:19:58.554394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.556140 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:19:58.611363 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beced71-5165-4025-add6-8e46db38bbad admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.615576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.616204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.616488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.616766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.625727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.627194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.636859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1354/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:19:58.720305 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:19:58.730442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70759dfe-601a-47ad-a4df-9aba8a69f53d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:19:58.734066 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a458c-0c04-46c1-bcd6-62f25390a85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:19:58.734745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a458c-0c04-46c1-bcd6-62f25390a85d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:19:58.735034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a458c-0c04-46c1-bcd6-62f25390a85d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:19:58.735320 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a458c-0c04-46c1-bcd6-62f25390a85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:19:58.791012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a458c-0c04-46c1-bcd6-62f25390a85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:19:58.792419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a458c-0c04-46c1-bcd6-62f25390a85d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:19:58.802215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1368/2722] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:19:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:03.390815 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:03.435672 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:03.453665 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0ee5-0354-4f5f-9f25-16f6b07e4f9e service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:03.458197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:03.459164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:03.459446 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:03.459722 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] PATH_INFO: `/v3/users/6485c410c7cf4d14890a40dec16e5189` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:03.460894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6485c410c7cf4d14890a40dec16e5189)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:03.462865 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:03.508343 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6485c410c7cf4d14890a40dec16e5189'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:03.515348 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6485c410c7cf4d14890a40dec16e5189'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:03.515995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6485c410c7cf4d14890a40dec16e5189'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:03.516616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6485c410c7cf4d14890a40dec16e5189'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:03.528021 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6485c410c7cf4d14890a40dec16e5189'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:03.540271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1355/2723] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:03 2022] DELETE /identity/v3/users/6485c410c7cf4d14890a40dec16e5189 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:03.544741 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:03.545225 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:03.545327 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:03.562574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:03.563701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:03.621654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1369/2724] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:03.631741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:03.633386 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:03.688499 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab3eef-77ec-45f2-92a9-1aa18bfffcc0 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:03.692695 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:03.693327 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:03.693613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:03.693895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:03.702809 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:03.704224 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:03.713528 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1356/2725] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:03.970553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:03.972457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:03.984523 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdc9f3-33eb-4859-93c1-714d0a49e842 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:03.989819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:03.990823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:03.991108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:03.991381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] PATH_INFO: `/v3/projects/92dc264d2efa4eaca34853ed9e0542ee` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:03.992804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=92dc264d2efa4eaca34853ed9e0542ee)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:03.994725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.017060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:04.043191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92dc264d2efa4eaca34853ed9e0542ee', 'request_id': 'req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.048646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92dc264d2efa4eaca34853ed9e0542ee', 'request_id': 'req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.055518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92dc264d2efa4eaca34853ed9e0542ee', 'request_id': 'req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.067466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] The token cache is being invalidate because project 92dc264d2efa4eaca34853ed9e0542ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:04.067753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.068362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.069888 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1370/2726] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:03 2022] DELETE /identity/v3/projects/92dc264d2efa4eaca34853ed9e0542ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:04.073848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.083406 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb91a0c-303f-41ce-951b-2f86bfd6dd73 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:04.139655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:04.140520 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.140805 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.141084 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] PATH_INFO: `/v3/users/aa4e8495221f44b9af689bafa7bdc605` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.142297 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa4e8495221f44b9af689bafa7bdc605)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:04.144732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.149989 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:04.191176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa4e8495221f44b9af689bafa7bdc605'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.198351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa4e8495221f44b9af689bafa7bdc605'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.199009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa4e8495221f44b9af689bafa7bdc605'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.199620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa4e8495221f44b9af689bafa7bdc605'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.211996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d84081bc-17da-442e-9b1c-e8ace7085e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa4e8495221f44b9af689bafa7bdc605'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.224661 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1357/2727] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:04 2022] DELETE /identity/v3/users/aa4e8495221f44b9af689bafa7bdc605 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:04.494940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.496391 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:04.511303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ffa1d-5e0d-48d7-9550-50e0d602c0ac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:04.568249 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:04.569261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.569546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.569825 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] PATH_INFO: `/v3/projects/f0b55c3bb98547479d52951c2b277888` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.571054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b55c3bb98547479d52951c2b277888)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:04.572957 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.618701 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b55c3bb98547479d52951c2b277888', 'request_id': 'req-845696e1-256e-491b-b049-e34b6505d214'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.626108 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b55c3bb98547479d52951c2b277888', 'request_id': 'req-845696e1-256e-491b-b049-e34b6505d214'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.633303 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b55c3bb98547479d52951c2b277888', 'request_id': 'req-845696e1-256e-491b-b049-e34b6505d214'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.646335 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] The token cache is being invalidate because project f0b55c3bb98547479d52951c2b277888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:04.646556 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.647171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-845696e1-256e-491b-b049-e34b6505d214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:04.648691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1371/2728] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:04 2022] DELETE /identity/v3/projects/f0b55c3bb98547479d52951c2b277888 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:04.653668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.654116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.654255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.672074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:04.673256 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:04.738523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1358/2729] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:04.747242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.747531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.747832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.766512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:04.767702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:04.776192 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1372/2730] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:04.780237 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.790353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a870f6-8b07-40d2-87bd-e22144691009 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:04.794866 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:04.795503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.795785 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.796056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.796775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:04.797077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:04.798711 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.810107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1359/2731] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:20:04.814184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.823813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b703605-0f4c-496f-ab36-5d88a3e86889 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:04.828427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:04.829070 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.829353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.829625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.830347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:04.832791 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.857095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1373/2732] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:04 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:04.861458 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.873393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca25c-4b02-4342-ae1b-954fa41867bb admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:04.928522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:04.929107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.929387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.929659 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.930372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:04.932277 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.952385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1360/2733] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:04 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:04.956629 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.966795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7fde-90b4-48ec-b307-90e31902035c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:04.971309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:04.971959 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:04.972241 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:04.972515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:04.973237 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:04.974872 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:04.976856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:04.986787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1374/2734] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:04.990628 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:04.996003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:05.002351 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78a2d2-58e3-4567-a464-c55701a0b9ba admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.009000 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e9f8c-356a-44c2-af77-e6a7f141de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.009651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9f8c-356a-44c2-af77-e6a7f141de95 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.009939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9f8c-356a-44c2-af77-e6a7f141de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.010236 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e9f8c-356a-44c2-af77-e6a7f141de95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.010983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9f8c-356a-44c2-af77-e6a7f141de95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.012602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e9f8c-356a-44c2-af77-e6a7f141de95 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.024444 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1361/2735] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:05.028868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.039197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d5b7c-b6a4-446d-be57-8d7a488b5b33 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.043827 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.044698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.044978 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.045251 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] PATH_INFO: `/v3/projects/3a21a4d5747247a6a82f1807ec8a2e54/users/214fe64f4d934fbfada42a6637840d65/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.059930 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a21a4d5747247a6a82f1807ec8a2e54, user_id=214fe64f4d934fbfada42a6637840d65, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.062596 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.075801 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1375/2736] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:05 2022] PUT /identity/v3/projects/3a21a4d5747247a6a82f1807ec8a2e54/users/214fe64f4d934fbfada42a6637840d65/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:05.136162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.136448 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.136727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.162369 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] MFA Rules not processed for user `214fe64f4d934fbfada42a6637840d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:05.163586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:05.225820 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1362/2737] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:05.230168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.290160 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45f3f9-21ad-4376-a6e5-f2c5e0106d3e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.294769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.295413 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.295694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.295968 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.296647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.298545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.323018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1376/2738] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:05 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:05.327058 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.337916 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1d72b-477e-48b6-bad1-c3c5a1fa3c7f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.392963 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.393945 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.394257 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.394542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.395255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.397188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.416485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1363/2739] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:05 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:05.420392 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.431185 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3364a0b-f406-4f8d-b80e-ea00ff066ec5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.435797 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.436441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.436722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.436997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.437720 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.439316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.449599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1377/2740] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:05.453467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.463341 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c1b2-a598-4366-a140-1cd3986b0f3d admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.467999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.468862 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.469144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.469421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] PATH_INFO: `/v3/projects/4dabe0b8345a4068aeed292399c55099/users/572b1f54a557425a8b44766da5309813/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.484303 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dabe0b8345a4068aeed292399c55099, user_id=572b1f54a557425a8b44766da5309813, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.486926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.500794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1364/2741] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:05 2022] PUT /identity/v3/projects/4dabe0b8345a4068aeed292399c55099/users/572b1f54a557425a8b44766da5309813/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:05.504813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.515146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18644-f7eb-4d27-92dd-11ff73e95813 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.569904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5edb1-789f-4f3a-b306-683c28edece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.570574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5edb1-789f-4f3a-b306-683c28edece2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.570857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5edb1-789f-4f3a-b306-683c28edece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.571129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5edb1-789f-4f3a-b306-683c28edece2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.571842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5edb1-789f-4f3a-b306-683c28edece2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.573431 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5edb1-789f-4f3a-b306-683c28edece2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.582871 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1378/2742] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:20:05.586959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.597617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6b44-75f8-4bb1-8654-eeb0d5d9c0e1 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.602263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.603231 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.603516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.603793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] PATH_INFO: `/v3/projects/4dabe0b8345a4068aeed292399c55099/users/572b1f54a557425a8b44766da5309813/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.605817 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dabe0b8345a4068aeed292399c55099, user_id=572b1f54a557425a8b44766da5309813, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.608558 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.620996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1365/2743] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:05 2022] PUT /identity/v3/projects/4dabe0b8345a4068aeed292399c55099/users/572b1f54a557425a8b44766da5309813/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:05.631293 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.631592 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.631877 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.657983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] MFA Rules not processed for user `572b1f54a557425a8b44766da5309813`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:05.660287 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:05.692270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:05.729350 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1379/2744] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:05.739966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:05.741690 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:05.776323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:05.799305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4348cf-edb1-4025-8b2a-77176d402e94 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:05.802999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39442073-e8f3-4c9c-8550-4c07aeb0857f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:05.803629 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39442073-e8f3-4c9c-8550-4c07aeb0857f service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:05.803910 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39442073-e8f3-4c9c-8550-4c07aeb0857f service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:05.804181 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39442073-e8f3-4c9c-8550-4c07aeb0857f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:05.813139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39442073-e8f3-4c9c-8550-4c07aeb0857f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:05.814585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39442073-e8f3-4c9c-8550-4c07aeb0857f service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:05.823799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1366/2745] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:06.207900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:06.267953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc854a10-5ce6-4935-a777-59d28a84c5a5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:06.273055 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:06.273914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:06.274195 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:06.274502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] PATH_INFO: `/v3/users/214fe64f4d934fbfada42a6637840d65` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:06.275687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214fe64f4d934fbfada42a6637840d65)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:06.277609 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:06.322285 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214fe64f4d934fbfada42a6637840d65'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.329027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214fe64f4d934fbfada42a6637840d65'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.329677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214fe64f4d934fbfada42a6637840d65'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.338085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214fe64f4d934fbfada42a6637840d65'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.338753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214fe64f4d934fbfada42a6637840d65'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.355705 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1380/2746] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:06 2022] DELETE /identity/v3/users/214fe64f4d934fbfada42a6637840d65 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:06.360150 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:06.360438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:06.360715 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:06.378057 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:06.379833 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:06.436511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1367/2747] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:06.446597 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:06.447982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:06.500306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:06.504960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e1ee1-c568-45d3-bd87-f438454874f1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:06.511015 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:06.512022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:06.512496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:06.513092 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:06.522765 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:06.524170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:06.533449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1381/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:06.796649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:06.798338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:06.811155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0f9b7-bfdd-4517-91b6-50eecc41c04a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:06.815775 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:06.816635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:06.816917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:06.817189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] PATH_INFO: `/v3/projects/3a21a4d5747247a6a82f1807ec8a2e54` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:06.818389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a21a4d5747247a6a82f1807ec8a2e54)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:06.820285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:06.866976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a21a4d5747247a6a82f1807ec8a2e54', 'request_id': 'req-925a99e6-a5ab-4070-ba75-1d52bc9834dc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.872551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a21a4d5747247a6a82f1807ec8a2e54', 'request_id': 'req-925a99e6-a5ab-4070-ba75-1d52bc9834dc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.878782 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a21a4d5747247a6a82f1807ec8a2e54', 'request_id': 'req-925a99e6-a5ab-4070-ba75-1d52bc9834dc'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.890669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] The token cache is being invalidate because project 3a21a4d5747247a6a82f1807ec8a2e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:06.890962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.891586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:06.893151 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1368/2749] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:06 2022] DELETE /identity/v3/projects/3a21a4d5747247a6a82f1807ec8a2e54 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:06.897212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:06.906946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cc3ce-15f3-4bb5-83ff-9f4e682407e2 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:06.963586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:06.964467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:06.964745 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:06.965016 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] PATH_INFO: `/v3/users/572b1f54a557425a8b44766da5309813` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:06.966215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=572b1f54a557425a8b44766da5309813)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:06.968229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.012830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572b1f54a557425a8b44766da5309813'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.019671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572b1f54a557425a8b44766da5309813'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.020340 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572b1f54a557425a8b44766da5309813'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.027646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572b1f54a557425a8b44766da5309813'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.028270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e0c81aa6-439e-4f10-99dc-c07f7af01f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572b1f54a557425a8b44766da5309813'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.046065 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1382/2750] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:06 2022] DELETE /identity/v3/users/572b1f54a557425a8b44766da5309813 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:20:07.316522 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.318009 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:07.332884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a99e6-a5ab-4070-ba75-1d52bc9834dc admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.389904 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.390806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.391088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.391366 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] PATH_INFO: `/v3/projects/4dabe0b8345a4068aeed292399c55099` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.392535 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dabe0b8345a4068aeed292399c55099)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.394959 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.396357 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:07.442738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dabe0b8345a4068aeed292399c55099', 'request_id': 'req-0a403a12-6867-4336-9925-00375133c6e9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.448507 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dabe0b8345a4068aeed292399c55099', 'request_id': 'req-0a403a12-6867-4336-9925-00375133c6e9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.454973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dabe0b8345a4068aeed292399c55099', 'request_id': 'req-0a403a12-6867-4336-9925-00375133c6e9'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.471203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] The token cache is being invalidate because project 4dabe0b8345a4068aeed292399c55099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:07.471525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.472924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-0a403a12-6867-4336-9925-00375133c6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:07.474424 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1369/2751] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:07 2022] DELETE /identity/v3/projects/4dabe0b8345a4068aeed292399c55099 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:07.479292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.479583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.479860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.498550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:07.500098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:07.558722 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1383/2752] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:07.568244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.568477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.568836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.587595 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:07.588796 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:07.596860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1370/2753] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:07.600992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.610787 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3346-a45a-4da9-89c0-f83e273c5d18 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.615279 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.615933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.616214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.616486 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.617239 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:07.617540 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.619133 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.625660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:07.634259 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1384/2754] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:20:07.637926 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.648540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85942a6-f672-4048-9068-fe1c7cb39db9 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.653152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.653789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.654068 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.654373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.655056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.656939 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.680501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1371/2755] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:07 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:07.684534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.695068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a3be6-f52f-4e84-9905-ccd9d3469c50 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.753643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.754500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.754829 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.756178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.757190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.759546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.780658 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1385/2756] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:07 2022] POST /identity/v3/users => generated 280 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:20:07.784223 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.794611 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565ad1e-00e5-443d-ab01-17264db48a08 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.799542 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.800200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.800484 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.800762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.801547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.803175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.814467 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1372/2757] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:07.819140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.829048 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67deba23-e329-4ab8-be86-b3fabccff9dc admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.834347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40bae-7c80-4b54-b438-b3df39595509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.834993 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40bae-7c80-4b54-b438-b3df39595509 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.835281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40bae-7c80-4b54-b438-b3df39595509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.835562 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40bae-7c80-4b54-b438-b3df39595509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.836288 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40bae-7c80-4b54-b438-b3df39595509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.837867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40bae-7c80-4b54-b438-b3df39595509 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.847631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1386/2758] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:20:07.851426 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:07.861364 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a65d4c-ea78-4ca4-82b1-64d1af7450ff admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:07.866750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:07.867624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.867908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.868187 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] PATH_INFO: `/v3/projects/5b1df0c5684149c49b5b70253aee62ce/users/b42a2099ccc44a45bac1364b0590b753/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.883933 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1df0c5684149c49b5b70253aee62ce, user_id=b42a2099ccc44a45bac1364b0590b753, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:07.886627 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:07.899048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1373/2759] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:07 2022] PUT /identity/v3/projects/5b1df0c5684149c49b5b70253aee62ce/users/b42a2099ccc44a45bac1364b0590b753/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:07.909373 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:07.909852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:07.909951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:07.935946 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] MFA Rules not processed for user `b42a2099ccc44a45bac1364b0590b753`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:07.937128 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:07.998467 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1387/2760] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:07 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:08.029732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:08.031853 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:08.087254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d492aa9-379a-4f5b-a255-19e6da5b3ff2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:08.090871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d704a-15b3-40b0-81f1-aaa5b52ee8b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:08.091508 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d704a-15b3-40b0-81f1-aaa5b52ee8b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.091795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d704a-15b3-40b0-81f1-aaa5b52ee8b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.092071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d704a-15b3-40b0-81f1-aaa5b52ee8b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.100249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d704a-15b3-40b0-81f1-aaa5b52ee8b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:08.101655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d704a-15b3-40b0-81f1-aaa5b52ee8b1 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:08.110409 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1374/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:08 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:08.125156 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:08.187178 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909f82-ce9a-47b0-a4bb-310f281b6e3b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:08.192516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:08.193410 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.193690 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.193973 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] PATH_INFO: `/v3/users/b42a2099ccc44a45bac1364b0590b753` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.195209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42a2099ccc44a45bac1364b0590b753)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:08.197120 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:08.202503 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:08.243411 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42a2099ccc44a45bac1364b0590b753'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.250199 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42a2099ccc44a45bac1364b0590b753'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.250894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42a2099ccc44a45bac1364b0590b753'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.258268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42a2099ccc44a45bac1364b0590b753'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.258901 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42a2099ccc44a45bac1364b0590b753'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.276005 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1388/2762] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:08 2022] DELETE /identity/v3/users/b42a2099ccc44a45bac1364b0590b753 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:08.280487 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.280777 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.281062 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.298421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:08.299617 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:08.324144 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:08.359518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1375/2763] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:08.369728 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:08.371242 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:08.428109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbb682-c144-4279-b588-8df20ad2ec95 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:08.431702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03db67e-c829-4295-96a3-d4143b8905cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:08.432337 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03db67e-c829-4295-96a3-d4143b8905cc service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.432615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03db67e-c829-4295-96a3-d4143b8905cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.432889 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03db67e-c829-4295-96a3-d4143b8905cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.441704 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03db67e-c829-4295-96a3-d4143b8905cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:08.443142 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03db67e-c829-4295-96a3-d4143b8905cc service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:08.452381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1389/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:08.720328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:08.720328 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:08.732481 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ee3a3-c088-42b5-8005-dba298673f92 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:08.737152 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:08.738004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.738331 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.738616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] PATH_INFO: `/v3/projects/5b1df0c5684149c49b5b70253aee62ce` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.740003 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1df0c5684149c49b5b70253aee62ce)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:08.741931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:08.788198 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1df0c5684149c49b5b70253aee62ce', 'request_id': 'req-d806ace7-e336-4314-bc3f-4021eb0e75b5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.793642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1df0c5684149c49b5b70253aee62ce', 'request_id': 'req-d806ace7-e336-4314-bc3f-4021eb0e75b5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.799960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1df0c5684149c49b5b70253aee62ce', 'request_id': 'req-d806ace7-e336-4314-bc3f-4021eb0e75b5'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.812608 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] The token cache is being invalidate because project 5b1df0c5684149c49b5b70253aee62ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:08.812898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.813526 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-d806ace7-e336-4314-bc3f-4021eb0e75b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:08.815102 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1376/2765] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:08 2022] DELETE /identity/v3/projects/5b1df0c5684149c49b5b70253aee62ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:08.819967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.820263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.820545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.838170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:08.839400 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:08.901043 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1390/2766] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:08.908776 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.909075 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.909440 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.927826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:08.929026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:08.936973 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1377/2767] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:08.940937 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:08.950660 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be3a1-7c44-4251-8f01-d5f6ab5091c6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:08.955252 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:08.955899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.956709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.956988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.957714 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:08.958027 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:08.959643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:08.970954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1391/2768] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:20:08.975791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:08.984974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f216b-bf6b-4e84-a64d-cf95c4f6fa70 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:08.989706 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:08.990385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:08.990675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:08.990956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:08.991651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:08.993580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.019633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1378/2769] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:08 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:09.023699 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.033847 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36159bdb-4fe5-44ca-aa20-4e10275cd36c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.045094 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:09.091409 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.092068 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.092349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.092624 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.093304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.095224 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.113709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1392/2770] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:20:09.117977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.128730 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df966895-acfc-455f-8610-77bcd4123622 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.133616 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.134288 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.134578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.134855 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.135575 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.137162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.147860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1379/2771] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:09.151667 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.161309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146efe9c-47a6-4c2f-aa35-512bcf9bd2a8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.165799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a497a-7734-4a60-a9db-cf9640fc53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.166472 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a497a-7734-4a60-a9db-cf9640fc53c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.166753 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a497a-7734-4a60-a9db-cf9640fc53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.167029 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a497a-7734-4a60-a9db-cf9640fc53c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.167748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a497a-7734-4a60-a9db-cf9640fc53c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.169307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a497a-7734-4a60-a9db-cf9640fc53c7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.178991 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1393/2772] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:20:09.182852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.193373 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea8d75-36f9-406a-b462-fadc34b6c572 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.197952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.198851 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.199129 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.199405 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] PATH_INFO: `/v3/projects/e6c9aa2df2514b2ab810dedf6985328d/users/8f9fc6b494cd4f6694a34e947de2af7d/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.214387 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c9aa2df2514b2ab810dedf6985328d, user_id=8f9fc6b494cd4f6694a34e947de2af7d, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.217147 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.229501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1380/2773] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:09 2022] PUT /identity/v3/projects/e6c9aa2df2514b2ab810dedf6985328d/users/8f9fc6b494cd4f6694a34e947de2af7d/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:09.240554 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.240849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.241125 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.268531 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] MFA Rules not processed for user `8f9fc6b494cd4f6694a34e947de2af7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:09.270276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:09.333132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1394/2774] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:09.337580 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.385503 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:09.400393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b31c7-2820-4ab7-a541-33af28194907 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.405320 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.405944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.406253 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.406544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.407247 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.409217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.434612 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1381/2775] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:09.438687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.449846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cee9b-8eaf-471a-acd2-f2c8b863e36c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.504031 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.504694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.504984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.505255 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.505944 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.508146 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.526129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1395/2776] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:09.530271 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.540403 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67ee02-da8f-4f41-a8c8-7106fb964689 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.545056 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.545707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.545994 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.546310 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.547095 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.548683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.559576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1382/2777] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:09.563389 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.573929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc6e02-a8fd-45a8-81cf-8fba728af2b0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.578570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53086256-aee2-48f1-87f2-24d009fe1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.579213 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086256-aee2-48f1-87f2-24d009fe1404 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.579500 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086256-aee2-48f1-87f2-24d009fe1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.579779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086256-aee2-48f1-87f2-24d009fe1404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.580505 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086256-aee2-48f1-87f2-24d009fe1404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.582093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53086256-aee2-48f1-87f2-24d009fe1404 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.591823 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1396/2778] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:09.595633 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.605537 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ed1f7-6f22-47a6-aebe-f727515199b3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.610204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.611117 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.611388 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.611664 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] PATH_INFO: `/v3/projects/154f66a9fe7d4a69a018fc4e07a79221/users/b0f883e43462414990b1f51863a48723/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.627066 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154f66a9fe7d4a69a018fc4e07a79221, user_id=b0f883e43462414990b1f51863a48723, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.630371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.643123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1383/2779] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:09 2022] PUT /identity/v3/projects/154f66a9fe7d4a69a018fc4e07a79221/users/b0f883e43462414990b1f51863a48723/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:09.653377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.653669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.653951 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.659832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:09.682028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] MFA Rules not processed for user `b0f883e43462414990b1f51863a48723`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:09.683263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:09.747091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1397/2780] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:09.751423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.811329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a100ff-f7db-43fc-9de9-24c483b73f83 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.816217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.816871 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.817156 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.817433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.818131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.820089 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.844509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1384/2781] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:09.848974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.859548 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa73d5-bb73-40eb-aa14-6d30e2ac16b7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.915580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.916171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.916459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.916736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.917430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.919361 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.938574 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1398/2782] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:09 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:09.942669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.952794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa99ee-0a06-40d0-89cb-20c6fa1fd338 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.957384 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.958035 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.958353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.958630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:09.959346 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:09.960927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:09.972510 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1385/2783] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:09.976261 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:09.986036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331181d2-6af4-4261-97de-87c69bc376d2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:09.991331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:09.992263 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:09.992550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:09.992828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] PATH_INFO: `/v3/projects/147fccd3ed614dcf9c636130f5a23ef9/users/9607d97f336548f98b43f16ffb1d2ff1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:10.008091 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147fccd3ed614dcf9c636130f5a23ef9, user_id=9607d97f336548f98b43f16ffb1d2ff1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:10.010788 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:10.024321 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1399/2784] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:09 2022] PUT /identity/v3/projects/147fccd3ed614dcf9c636130f5a23ef9/users/9607d97f336548f98b43f16ffb1d2ff1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:10.028501 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:10.039269 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fbc2a-0b13-4c95-adb2-4ee42d7b48ff admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:10.094114 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ae5c-5b2f-403b-b577-92534eb44cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:10.094799 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ae5c-5b2f-403b-b577-92534eb44cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:10.095086 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ae5c-5b2f-403b-b577-92534eb44cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:10.095365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ae5c-5b2f-403b-b577-92534eb44cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:10.096082 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ae5c-5b2f-403b-b577-92534eb44cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:10.098179 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03ae5c-5b2f-403b-b577-92534eb44cb7 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:10.107780 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1386/2785] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:10.112001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:10.122997 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092007d-af05-4df1-9928-6960ffcd4575 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:10.127702 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:10.128579 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:10.128886 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:10.129164 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] PATH_INFO: `/v3/projects/147fccd3ed614dcf9c636130f5a23ef9/users/9607d97f336548f98b43f16ffb1d2ff1/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:10.131175 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=147fccd3ed614dcf9c636130f5a23ef9, user_id=9607d97f336548f98b43f16ffb1d2ff1, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:10.134071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:10.144674 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1400/2786] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:10 2022] PUT /identity/v3/projects/147fccd3ed614dcf9c636130f5a23ef9/users/9607d97f336548f98b43f16ffb1d2ff1/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:20:10.155726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:10.156017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:10.156299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:10.174642 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:10.183361 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] MFA Rules not processed for user `9607d97f336548f98b43f16ffb1d2ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:10.184884 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:10.253453 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1387/2787] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:10.264586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:10.266322 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:10.312940 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:10.323864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749f99-956c-4f05-a0e8-9fa35b3f4aab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:10.327537 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:10.328200 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:10.328483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:10.328755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:10.383934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:10.385352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:10.394618 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1401/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:11.854540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:11.855923 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:11.869004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e12ae-0975-40d0-9290-2bd8898ea04f None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:11.872641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:11.873285 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:11.873568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:11.873844 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:11.929597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:11.930987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:11.939729 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1388/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:12.432887 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:12.442025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a84c69-de10-47ab-9b27-8a741586b530 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:12.445631 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:12.446295 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:12.446580 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:12.446856 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:12.455757 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:12.457132 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:12.466527 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1402/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:16.226753 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:16.235491 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7b149-64ce-48af-bf6c-59b0bd96e85e service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:16.242719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:16.242719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:16.242719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:16.242719 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:16.243105 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:16.285953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:16.315854 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:16.317299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9f530-5a15-460d-b663-f12a7e82076a service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:16.328506 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1389/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:16.349056 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e00e39-5b6c-4caa-a21c-86daaeed659b service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:16.353671 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:16.354570 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:16.354864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:16.355139 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] PATH_INFO: `/v3/users/8f9fc6b494cd4f6694a34e947de2af7d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:16.356347 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9fc6b494cd4f6694a34e947de2af7d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:16.358270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:16.406290 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9fc6b494cd4f6694a34e947de2af7d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:16.414979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9fc6b494cd4f6694a34e947de2af7d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:16.415689 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9fc6b494cd4f6694a34e947de2af7d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:16.423306 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9fc6b494cd4f6694a34e947de2af7d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:16.423925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9fc6b494cd4f6694a34e947de2af7d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:16.445060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1403/2792] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:16 2022] DELETE /identity/v3/users/8f9fc6b494cd4f6694a34e947de2af7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:20:16.449818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:16.449999 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:16.450305 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:16.468192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:16.469396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:16.483048 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=100 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:16.537669 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1390/2793] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:16.551838 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:16.553439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:16.561692 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:16.622466 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e568c6b9-6b80-4815-8196-87316710dbe1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:16.626138 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:16.626963 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:16.627129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:16.627408 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:16.637998 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:16.639450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:16.650025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1404/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:16.928312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:16.929733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:16.942527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bc91a-b42a-44f9-bd05-e877cecf37fd None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:16.947338 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:16.948249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:16.948514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:16.948792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] PATH_INFO: `/v3/projects/e6c9aa2df2514b2ab810dedf6985328d` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:16.950004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c9aa2df2514b2ab810dedf6985328d)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:16.951955 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:16.998008 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c9aa2df2514b2ab810dedf6985328d', 'request_id': 'req-8f3ae871-2c89-4649-b841-af0eabbb3e7b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.004422 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c9aa2df2514b2ab810dedf6985328d', 'request_id': 'req-8f3ae871-2c89-4649-b841-af0eabbb3e7b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.011092 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c9aa2df2514b2ab810dedf6985328d', 'request_id': 'req-8f3ae871-2c89-4649-b841-af0eabbb3e7b'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.023032 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] The token cache is being invalidate because project e6c9aa2df2514b2ab810dedf6985328d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:17.023318 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.023927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.025463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1391/2795] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:16 2022] DELETE /identity/v3/projects/e6c9aa2df2514b2ab810dedf6985328d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:17.029471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:17.039542 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8da01-24b7-49ee-8824-18234fc2135c service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:17.096524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:17.097388 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:17.098289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:17.098577 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] PATH_INFO: `/v3/users/b0f883e43462414990b1f51863a48723` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:17.099775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f883e43462414990b1f51863a48723)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:17.101677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:17.149088 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f883e43462414990b1f51863a48723'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.156982 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f883e43462414990b1f51863a48723'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.158151 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f883e43462414990b1f51863a48723'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.166730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f883e43462414990b1f51863a48723'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.167339 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f883e43462414990b1f51863a48723'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.186869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1405/2796] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:17 2022] DELETE /identity/v3/users/b0f883e43462414990b1f51863a48723 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:17.457592 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:17.459205 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:17.473470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae871-2c89-4649-b841-af0eabbb3e7b admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:17.548192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:17.549304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:17.549698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:17.549948 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] PATH_INFO: `/v3/projects/154f66a9fe7d4a69a018fc4e07a79221` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:17.551474 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=154f66a9fe7d4a69a018fc4e07a79221)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:17.553579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:17.597975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:17.602121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154f66a9fe7d4a69a018fc4e07a79221', 'request_id': 'req-8e78380f-43d3-4c17-868e-b5c4fc08e706'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.609421 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154f66a9fe7d4a69a018fc4e07a79221', 'request_id': 'req-8e78380f-43d3-4c17-868e-b5c4fc08e706'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.619641 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154f66a9fe7d4a69a018fc4e07a79221', 'request_id': 'req-8e78380f-43d3-4c17-868e-b5c4fc08e706'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.634512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] The token cache is being invalidate because project 154f66a9fe7d4a69a018fc4e07a79221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:17.634803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.635469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.637020 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1392/2797] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:17 2022] DELETE /identity/v3/projects/154f66a9fe7d4a69a018fc4e07a79221 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:17.640971 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:17.642433 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:17.656590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7f475-f9a6-45d4-bb1e-7fc497b7764c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:17.682396 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:17.717786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:17.718706 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:17.718979 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:17.719282 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] PATH_INFO: `/v3/users/9607d97f336548f98b43f16ffb1d2ff1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:17.720482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9607d97f336548f98b43f16ffb1d2ff1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:17.722425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:17.771672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9607d97f336548f98b43f16ffb1d2ff1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.778634 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9607d97f336548f98b43f16ffb1d2ff1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.779302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9607d97f336548f98b43f16ffb1d2ff1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.786832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9607d97f336548f98b43f16ffb1d2ff1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.787465 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9607d97f336548f98b43f16ffb1d2ff1'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:17.805377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1406/2798] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:17 2022] DELETE /identity/v3/users/9607d97f336548f98b43f16ffb1d2ff1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:17.867081 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:17.868803 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:17.931471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78380f-43d3-4c17-868e-b5c4fc08e706 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:17.982860 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:17.983512 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:17.983795 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:17.984072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:17.985908 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:18.060254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:18.061867 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:18.075034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1393/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:18.086588 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:18.089184 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:18.172515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769914-429b-40cd-a3f0-b21670ebdee0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:18.177216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:18.178152 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:18.178450 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:18.178733 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] PATH_INFO: `/v3/projects/147fccd3ed614dcf9c636130f5a23ef9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:18.179962 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=147fccd3ed614dcf9c636130f5a23ef9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:18.181843 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:18.232880 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:18.235137 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147fccd3ed614dcf9c636130f5a23ef9', 'request_id': 'req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:18.245292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147fccd3ed614dcf9c636130f5a23ef9', 'request_id': 'req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:18.254358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147fccd3ed614dcf9c636130f5a23ef9', 'request_id': 'req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:18.267420 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] The token cache is being invalidate because project 147fccd3ed614dcf9c636130f5a23ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:18.267710 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:18.268324 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:18.270586 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1407/2800] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:18 2022] DELETE /identity/v3/projects/147fccd3ed614dcf9c636130f5a23ef9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:28.068907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=82,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:28.264254 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:30.447016 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:30.448488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:30.461902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd1037-2c30-46a9-bd22-546a22c83515 service cinder] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:30.517794 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:30.518713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:30.518974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:30.519801 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] PATH_INFO: `/v3/users/6c5967ba9a064769b3c6135bd6f55338` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:30.520971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c5967ba9a064769b3c6135bd6f55338)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:30.522924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:30.572283 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c5967ba9a064769b3c6135bd6f55338'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.583482 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c5967ba9a064769b3c6135bd6f55338'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.584309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c5967ba9a064769b3c6135bd6f55338'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.585045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c5967ba9a064769b3c6135bd6f55338'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.597173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-f8facd89-669a-4f66-8a4c-5eb96175a653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c5967ba9a064769b3c6135bd6f55338'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.612390 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1394/2801] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:30 2022] DELETE /identity/v3/users/6c5967ba9a064769b3c6135bd6f55338 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:30.786967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:30.788594 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:30.804784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cf1d8-c4b6-469d-ad8e-57bd9c185876 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:30.863398 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:30.864653 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:30.864955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:30.865515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] PATH_INFO: `/v3/projects/cf3b17c38a9c4fc0aa0082cbb88f92bd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:30.866868 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3b17c38a9c4fc0aa0082cbb88f92bd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:30.868758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:30.914359 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3b17c38a9c4fc0aa0082cbb88f92bd', 'request_id': 'req-4caa0a1a-2039-4314-aeb2-618e0f6976ff'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.919694 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3b17c38a9c4fc0aa0082cbb88f92bd', 'request_id': 'req-4caa0a1a-2039-4314-aeb2-618e0f6976ff'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.925718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3b17c38a9c4fc0aa0082cbb88f92bd', 'request_id': 'req-4caa0a1a-2039-4314-aeb2-618e0f6976ff'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.937551 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] The token cache is being invalidate because project cf3b17c38a9c4fc0aa0082cbb88f92bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:30.937842 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.938478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4caa0a1a-2039-4314-aeb2-618e0f6976ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:30.940004 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1408/2802] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:30 2022] DELETE /identity/v3/projects/cf3b17c38a9c4fc0aa0082cbb88f92bd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:30.945393 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:30.945710 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:30.945996 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:30.964013 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:30.965196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:31.024034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1395/2803] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:31.031459 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.031775 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.032057 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.051197 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:31.052384 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:31.060218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1409/2804] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:31.064452 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.074004 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8cc2a-d72d-41ad-8ffe-18c1e466d51a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.078602 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.079245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.079524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.079793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.080514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:31.080818 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.082966 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.094128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1396/2805] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:20:31.098914 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.108114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86eaa3-1a88-4b43-a19c-8aafa4d220a4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.112746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.113403 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.113688 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.113965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.114684 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.116564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.141190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1410/2806] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:20:31.145705 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.155713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0d4a9-854e-4664-892b-e6f42c764b8f admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.159334 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:31.212750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.213598 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.213885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.214160 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.214876 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.217254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.236751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1397/2807] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:31.241545 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.251550 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75a555-4cf0-4e5e-b364-9f8c77cd2d81 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.256666 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.257310 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.257591 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.258145 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.258904 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.260478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.271370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1411/2808] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:31.275077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.284788 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feef15a-dff5-4737-9de0-c9f68de25a32 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.289284 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b784d35-c37b-4ff1-8e99-51ab81c75e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.289927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784d35-c37b-4ff1-8e99-51ab81c75e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.290211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784d35-c37b-4ff1-8e99-51ab81c75e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.290515 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b784d35-c37b-4ff1-8e99-51ab81c75e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.291238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b784d35-c37b-4ff1-8e99-51ab81c75e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.292832 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b784d35-c37b-4ff1-8e99-51ab81c75e21 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.307139 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1398/2809] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:31.308569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.319358 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4eed6-00ef-4963-b5ea-8381d4e5a6f2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.324026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.324917 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.325191 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.325471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] PATH_INFO: `/v3/projects/fce3a26beb8a4ee08966161956ae7e6f/users/eb78be72cf124e25b8e0161a244c7775/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.339955 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce3a26beb8a4ee08966161956ae7e6f, user_id=eb78be72cf124e25b8e0161a244c7775, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.342639 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.355119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1412/2810] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:31 2022] PUT /identity/v3/projects/fce3a26beb8a4ee08966161956ae7e6f/users/eb78be72cf124e25b8e0161a244c7775/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:31.365649 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.365937 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.366215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.392574 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] MFA Rules not processed for user `eb78be72cf124e25b8e0161a244c7775`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:31.393766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:31.455953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1399/2811] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:31.460382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.490736 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:31.524299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d420a-6b9d-494a-a377-7d724a0bf037 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.528988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.529645 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.529932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.530216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.530947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.532837 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.557864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1413/2812] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:31.561920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.572432 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b029989-9375-4d0f-bb34-6a44971c03eb None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.626658 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.627419 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.627703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.627979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.629173 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.631088 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.650670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1400/2813] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:31.655435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.665781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb118af-01e0-46c3-9b37-9ce361c01c05 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.670476 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.671136 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.671435 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.671715 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.672449 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.674038 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.685546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1414/2814] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:31.689610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.696504 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:31.700527 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99eca7-071c-473f-9939-5c920672f096 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.706070 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.707621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.707898 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.708171 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] PATH_INFO: `/v3/projects/06a5872eb98a4fe088d8c2acc5cf5094/users/0de59cbbb02d4c0b9ea161ad0c3e0450/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.723107 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a5872eb98a4fe088d8c2acc5cf5094, user_id=0de59cbbb02d4c0b9ea161ad0c3e0450, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.725746 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.737678 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1401/2815] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:31 2022] PUT /identity/v3/projects/06a5872eb98a4fe088d8c2acc5cf5094/users/0de59cbbb02d4c0b9ea161ad0c3e0450/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:31.741590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.751352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aabe4f-d73f-4c7e-9108-ab5330c1f8de admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.807033 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162b840-766c-484a-97d6-e737696acd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.807707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b840-766c-484a-97d6-e737696acd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.807996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b840-766c-484a-97d6-e737696acd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.808276 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162b840-766c-484a-97d6-e737696acd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.809013 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b840-766c-484a-97d6-e737696acd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.810716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162b840-766c-484a-97d6-e737696acd1d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.821576 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1415/2816] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:31.825725 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.836680 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a8b0-9c8a-4ae0-88d7-d679917fa0a6 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:31.841252 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:31.842121 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.842431 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.842707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] PATH_INFO: `/v3/projects/06a5872eb98a4fe088d8c2acc5cf5094/users/0de59cbbb02d4c0b9ea161ad0c3e0450/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.844674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a5872eb98a4fe088d8c2acc5cf5094, user_id=0de59cbbb02d4c0b9ea161ad0c3e0450, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:31.847345 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:31.857116 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1402/2817] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:31 2022] PUT /identity/v3/projects/06a5872eb98a4fe088d8c2acc5cf5094/users/0de59cbbb02d4c0b9ea161ad0c3e0450/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:31.869366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:31.869661 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:31.869943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:31.896672 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] MFA Rules not processed for user `0de59cbbb02d4c0b9ea161ad0c3e0450`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:31.897943 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:31.964229 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1416/2818] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:31.974720 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:31.976401 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:32.034002 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b4120-c808-4dd7-acd5-6310e809e851 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:32.038551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822aeea-fd4d-41ff-b389-6162571bc2f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:32.039228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822aeea-fd4d-41ff-b389-6162571bc2f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:32.039511 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822aeea-fd4d-41ff-b389-6162571bc2f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:32.039788 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822aeea-fd4d-41ff-b389-6162571bc2f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:32.048757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822aeea-fd4d-41ff-b389-6162571bc2f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:32.050188 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822aeea-fd4d-41ff-b389-6162571bc2f8 service cinder] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:32.059578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1403/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:32.182442 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:32.208022 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:32.246169 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316568a-d873-4643-ab42-3ee5131e715a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:32.250644 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:32.251492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:32.251769 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:32.252040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] PATH_INFO: `/v3/users/eb78be72cf124e25b8e0161a244c7775` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:32.253212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb78be72cf124e25b8e0161a244c7775)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:32.255141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:32.301983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb78be72cf124e25b8e0161a244c7775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.308740 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb78be72cf124e25b8e0161a244c7775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.309402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb78be72cf124e25b8e0161a244c7775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.317610 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb78be72cf124e25b8e0161a244c7775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.318244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb78be72cf124e25b8e0161a244c7775'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.335214 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1417/2820] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:32 2022] DELETE /identity/v3/users/eb78be72cf124e25b8e0161a244c7775 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:32.339662 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:32.339960 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:32.340244 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:32.357992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:32.359225 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:32.417146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1404/2821] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:32.427173 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:32.428557 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:32.484269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1ae3f-772f-4b25-9dd9-ea6ca12d6e0e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:32.488446 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:32.489098 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:32.489377 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:32.489652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:32.498534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:32.499965 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:32.509491 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1418/2822] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:32.770906 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:32.772457 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:32.784463 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec28b82-0539-40b7-b215-7fbbbaf8f2ce None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:32.789080 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:32.789936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:32.790238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:32.790562 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] PATH_INFO: `/v3/projects/fce3a26beb8a4ee08966161956ae7e6f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:32.791852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce3a26beb8a4ee08966161956ae7e6f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:32.793760 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:32.843260 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce3a26beb8a4ee08966161956ae7e6f', 'request_id': 'req-7b9494bd-07b7-4cab-bdd6-d705637b9522'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.849312 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce3a26beb8a4ee08966161956ae7e6f', 'request_id': 'req-7b9494bd-07b7-4cab-bdd6-d705637b9522'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.855450 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce3a26beb8a4ee08966161956ae7e6f', 'request_id': 'req-7b9494bd-07b7-4cab-bdd6-d705637b9522'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.857826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:32.871294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] The token cache is being invalidate because project fce3a26beb8a4ee08966161956ae7e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:32.871585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.872212 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.873766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1405/2823] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:32 2022] DELETE /identity/v3/projects/fce3a26beb8a4ee08966161956ae7e6f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:32.877804 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:32.887812 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e607f6-2d5f-46e1-bb0c-17dd46a2ddad service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:32.928832 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:32.944853 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:32.945708 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:32.945988 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:32.946292 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] PATH_INFO: `/v3/users/0de59cbbb02d4c0b9ea161ad0c3e0450` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:32.947479 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de59cbbb02d4c0b9ea161ad0c3e0450)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:32.949370 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:32.992840 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de59cbbb02d4c0b9ea161ad0c3e0450'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:32.999483 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de59cbbb02d4c0b9ea161ad0c3e0450'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.000129 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de59cbbb02d4c0b9ea161ad0c3e0450'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.007402 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de59cbbb02d4c0b9ea161ad0c3e0450'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.008427 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e3f6a903-4500-4bad-af50-39e70e89d93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de59cbbb02d4c0b9ea161ad0c3e0450'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.030096 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1419/2824] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:32 2022] DELETE /identity/v3/users/0de59cbbb02d4c0b9ea161ad0c3e0450 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:33.294518 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.295953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:33.308895 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9494bd-07b7-4cab-bdd6-d705637b9522 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.364956 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.366485 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.366766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.367038 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] PATH_INFO: `/v3/projects/06a5872eb98a4fe088d8c2acc5cf5094` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.368243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a5872eb98a4fe088d8c2acc5cf5094)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.370143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.414374 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a5872eb98a4fe088d8c2acc5cf5094', 'request_id': 'req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.419585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a5872eb98a4fe088d8c2acc5cf5094', 'request_id': 'req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.426232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a5872eb98a4fe088d8c2acc5cf5094', 'request_id': 'req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.437564 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] The token cache is being invalidate because project 06a5872eb98a4fe088d8c2acc5cf5094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80254) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:33.437863 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.438500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-39c4dec7-3dfb-4d11-b3c3-d0503a4a1849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:33.439984 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1406/2825] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:33 2022] DELETE /identity/v3/projects/06a5872eb98a4fe088d8c2acc5cf5094 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:33.445430 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.445746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.446028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.463748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:33.464941 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:33.522268 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1420/2826] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:33.530354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.530645 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.530925 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.548872 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:33.550059 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:33.558486 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1407/2827] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:33.562630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.572776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2f9b-269b-41dd-98e1-bd7df7ea0464 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.577302 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.577953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.578264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.578547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.579275 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:33.579584 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.581166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.592512 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1421/2828] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:20:33.596687 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.605824 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86629e7-71f2-4261-ba99-708f4d61dd6c None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.610430 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.611063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.611347 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.611620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.612306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.614738 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.639684 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1408/2829] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:33 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:20:33.643619 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.653524 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f050b7-ce36-4261-be55-6c874b475bc5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.700212 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:33.711852 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.712530 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.712819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.713099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.713795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.715737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.735369 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1422/2830] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:33 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:33.739376 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.749579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427d11-cf98-4359-b67c-a4cb11d3ab69 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.754735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.755385 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.755668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.755944 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.756668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.758541 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.768656 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1409/2831] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:33.773042 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.782907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eb4d4-81fb-476b-a25c-a7d39415af38 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.787502 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98de1bb-bb76-4bd6-b751-939ae2b0e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.788141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98de1bb-bb76-4bd6-b751-939ae2b0e449 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.788422 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98de1bb-bb76-4bd6-b751-939ae2b0e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.788698 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98de1bb-bb76-4bd6-b751-939ae2b0e449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.789419 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98de1bb-bb76-4bd6-b751-939ae2b0e449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.791025 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98de1bb-bb76-4bd6-b751-939ae2b0e449 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.802453 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1423/2832] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:33.806294 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.816603 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ace7a-f607-42b0-9d49-fe0701509589 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:33.821238 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:33.822072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.822392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.822668 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] PATH_INFO: `/v3/projects/ea515fb6243946d89abddfd01826334b/users/23f900ec04224c5b92365b0180bdce1f/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.837332 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea515fb6243946d89abddfd01826334b, user_id=23f900ec04224c5b92365b0180bdce1f, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:33.840028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:33.852291 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1410/2833] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:33 2022] PUT /identity/v3/projects/ea515fb6243946d89abddfd01826334b/users/23f900ec04224c5b92365b0180bdce1f/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:33.862447 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:33.862903 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:33.863107 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:33.890144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] MFA Rules not processed for user `23f900ec04224c5b92365b0180bdce1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:33.891352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:33.954080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1424/2834] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:33.959055 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:33.979516 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:34.022571 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795e1b-ffa3-4cee-8a83-550e60f8cb18 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.027411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.028083 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.028372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.028709 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] PATH_INFO: `/v3/projects` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.029420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.031359 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.056936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1411/2835] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:33 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:34.060960 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.071426 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748ab20-bc36-4bc3-8009-18a188d56e30 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.126085 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.127143 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.127613 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.127900 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.128601 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.130518 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.150707 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1425/2836] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:34 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:20:34.154703 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.165636 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b12c32-422f-48f8-950b-a9e1177ce5df admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.170243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.170889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.171170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.171443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.172164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.173747 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.184115 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1412/2837] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:34.188046 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.197813 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a8d1-4753-4f4b-a15c-6a235b7314b5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.202349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.203210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.203488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.203760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] PATH_INFO: `/v3/projects/e7383b8dbe244fb6b182acefb4e8b13a/users/24f0c79bb8d44235aa6eb3d3d9f56ab0/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.218480 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7383b8dbe244fb6b182acefb4e8b13a, user_id=24f0c79bb8d44235aa6eb3d3d9f56ab0, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.221035 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.233831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1426/2838] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:34 2022] PUT /identity/v3/projects/e7383b8dbe244fb6b182acefb4e8b13a/users/24f0c79bb8d44235aa6eb3d3d9f56ab0/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:20:34.237585 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.248077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615750-90d5-4d71-a77c-42ee4dde5ba3 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.303965 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb028445-ef48-43f7-81e9-2de76a21819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.304624 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028445-ef48-43f7-81e9-2de76a21819b admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.304914 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028445-ef48-43f7-81e9-2de76a21819b admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.305196 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028445-ef48-43f7-81e9-2de76a21819b admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.305922 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028445-ef48-43f7-81e9-2de76a21819b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.307552 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb028445-ef48-43f7-81e9-2de76a21819b admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.317733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1413/2839] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:20:34.321796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.332072 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed6fd6-6987-4bc1-9ce6-b3fa6955b203 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.336676 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.337552 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.337834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.338113 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] PATH_INFO: `/v3/projects/e7383b8dbe244fb6b182acefb4e8b13a/users/24f0c79bb8d44235aa6eb3d3d9f56ab0/roles/a5bcf8b6a0564fba816455253e926cb5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.340102 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7383b8dbe244fb6b182acefb4e8b13a, user_id=24f0c79bb8d44235aa6eb3d3d9f56ab0, role_id=a5bcf8b6a0564fba816455253e926cb5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.342748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.352716 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1427/2840] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:34 2022] PUT /identity/v3/projects/e7383b8dbe244fb6b182acefb4e8b13a/users/24f0c79bb8d44235aa6eb3d3d9f56ab0/roles/a5bcf8b6a0564fba816455253e926cb5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:34.364218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.364546 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.364830 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.391524 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] MFA Rules not processed for user `24f0c79bb8d44235aa6eb3d3d9f56ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:34.392735 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:34.459578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1414/2841] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:34.471141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.473331 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:34.486786 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:34.531860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5919-d66e-4bd1-b25e-d0ba878389ea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.536012 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d87991-8007-4a38-a65b-08001dc33e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.536649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d87991-8007-4a38-a65b-08001dc33e70 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.536934 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d87991-8007-4a38-a65b-08001dc33e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.537210 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d87991-8007-4a38-a65b-08001dc33e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.591270 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d87991-8007-4a38-a65b-08001dc33e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.592686 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d87991-8007-4a38-a65b-08001dc33e70 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.602080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1428/2842] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:37.106255 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:37.122879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:37.168786 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a222eb-856f-434a-bae6-be3d720a6f42 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:37.173299 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:37.174163 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:37.174476 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:37.174752 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] PATH_INFO: `/v3/users/23f900ec04224c5b92365b0180bdce1f` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:37.175969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f900ec04224c5b92365b0180bdce1f)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:37.177889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:37.230754 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f900ec04224c5b92365b0180bdce1f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.237579 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f900ec04224c5b92365b0180bdce1f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.238268 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f900ec04224c5b92365b0180bdce1f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.238919 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f900ec04224c5b92365b0180bdce1f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.250762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f900ec04224c5b92365b0180bdce1f'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.263902 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1415/2843] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:37 2022] DELETE /identity/v3/users/23f900ec04224c5b92365b0180bdce1f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:37.269730 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:37.270209 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:37.270353 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:37.287628 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:37.288747 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:37.348796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1429/2844] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:37.358750 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:37.360166 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:37.417551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf01c2-6f6d-4110-af6f-d6206b0f5f08 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:37.421176 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:37.421812 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:37.422091 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:37.422411 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:37.431383 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:37.432793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:37.442097 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1416/2845] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:37.699846 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:37.701289 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:37.716052 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5440e-a489-4312-b402-043cfe201c60 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:37.720675 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:37.721547 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:37.723150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:37.723760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] PATH_INFO: `/v3/projects/ea515fb6243946d89abddfd01826334b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:37.725060 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea515fb6243946d89abddfd01826334b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:37.726996 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:37.773970 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea515fb6243946d89abddfd01826334b', 'request_id': 'req-d1174b96-3887-4175-9f87-0187c51da27f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.781131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea515fb6243946d89abddfd01826334b', 'request_id': 'req-d1174b96-3887-4175-9f87-0187c51da27f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.783938 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:37.792558 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea515fb6243946d89abddfd01826334b', 'request_id': 'req-d1174b96-3887-4175-9f87-0187c51da27f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.804925 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] The token cache is being invalidate because project ea515fb6243946d89abddfd01826334b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:37.805218 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.805869 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.807436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1430/2846] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:37 2022] DELETE /identity/v3/projects/ea515fb6243946d89abddfd01826334b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:37.811370 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:37.821023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b50b0-8a20-4af2-a355-4c5d7d2ffa76 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:37.854442 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:37.879568 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:37.880433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:37.880713 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:37.880987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] PATH_INFO: `/v3/users/24f0c79bb8d44235aa6eb3d3d9f56ab0` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:37.882170 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f0c79bb8d44235aa6eb3d3d9f56ab0)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:37.884354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:37.928392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f0c79bb8d44235aa6eb3d3d9f56ab0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.935553 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f0c79bb8d44235aa6eb3d3d9f56ab0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.936200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f0c79bb8d44235aa6eb3d3d9f56ab0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.936793 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f0c79bb8d44235aa6eb3d3d9f56ab0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.948894 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-16a67c45-bf8d-460f-b296-9486572d7590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f0c79bb8d44235aa6eb3d3d9f56ab0'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:37.961551 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1417/2847] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:37 2022] DELETE /identity/v3/users/24f0c79bb8d44235aa6eb3d3d9f56ab0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:38.226423 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.228032 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:38.243950 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1174b96-3887-4175-9f87-0187c51da27f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.299948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.301313 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.302158 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.302470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] PATH_INFO: `/v3/projects/e7383b8dbe244fb6b182acefb4e8b13a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.303654 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7383b8dbe244fb6b182acefb4e8b13a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.305534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.350850 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7383b8dbe244fb6b182acefb4e8b13a', 'request_id': 'req-6f792a0a-2a99-41ad-a423-d466abec01de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:38.356147 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7383b8dbe244fb6b182acefb4e8b13a', 'request_id': 'req-6f792a0a-2a99-41ad-a423-d466abec01de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:38.362039 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7383b8dbe244fb6b182acefb4e8b13a', 'request_id': 'req-6f792a0a-2a99-41ad-a423-d466abec01de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:38.374605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] The token cache is being invalidate because project e7383b8dbe244fb6b182acefb4e8b13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:38.374894 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:38.375516 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6f792a0a-2a99-41ad-a423-d466abec01de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:38.377036 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1431/2848] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:38 2022] DELETE /identity/v3/projects/e7383b8dbe244fb6b182acefb4e8b13a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:38.382423 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.383164 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.383263 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.400732 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:38.401917 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:38.460675 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1418/2849] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:38.468379 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.468669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.468947 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.487772 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:38.489454 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:38.497230 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1432/2850] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:38.501404 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.511858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192b8f1-51fe-4522-990b-374f2af34612 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.516447 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.517087 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.517441 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.517757 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.518514 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:38.518822 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.520433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.531749 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1419/2851] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:20:38.535999 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.545759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1ba64-d276-4f56-b5da-ab2fa81da3b4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.550969 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.551622 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.551909 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.552194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.552907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.554817 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.580026 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1433/2852] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:38 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:38.584019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.593741 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938f084-f32a-471b-b343-61431b779c27 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.634396 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:38.650192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.650879 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.651162 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.651438 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.652123 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.654007 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.673698 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1420/2853] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:38 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:20:38.678603 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.688862 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d586-0494-4460-9226-e08464bd2a19 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.693517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.694168 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.694488 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.694768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.695498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.697075 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.707309 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1434/2854] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:38.711143 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.721019 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134a967-b4d3-42a4-b9e2-9c7bf8603392 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.726203 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3904b-3b2b-4c31-9b9e-f1807857592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.726881 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3904b-3b2b-4c31-9b9e-f1807857592f admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.727165 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3904b-3b2b-4c31-9b9e-f1807857592f admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.727471 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3904b-3b2b-4c31-9b9e-f1807857592f admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.728254 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3904b-3b2b-4c31-9b9e-f1807857592f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.730381 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3904b-3b2b-4c31-9b9e-f1807857592f admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.740726 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1421/2855] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:38.744725 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.754687 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3bbfa-539b-43d8-9ebc-8375857b1449 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.759623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.760492 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.760779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.761059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] PATH_INFO: `/v3/projects/6df9d806d82d474385bfd0ddbd7d5944/users/94a65a29858445e1a852581c60985b16/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.775365 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df9d806d82d474385bfd0ddbd7d5944, user_id=94a65a29858445e1a852581c60985b16, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.778008 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.790992 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1435/2856] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:38 2022] PUT /identity/v3/projects/6df9d806d82d474385bfd0ddbd7d5944/users/94a65a29858445e1a852581c60985b16/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:20:38.802727 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.803015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.803293 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.829287 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] MFA Rules not processed for user `94a65a29858445e1a852581c60985b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:38.830541 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:38.894561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1422/2857] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:20:38.905473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.907140 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:38.926281 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:38.965141 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6261b2-2630-444e-b800-145018b47177 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.968755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f5e68-ed7d-4fdc-a46e-732ddc5ee6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.969394 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5e68-ed7d-4fdc-a46e-732ddc5ee6ed service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.969677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5e68-ed7d-4fdc-a46e-732ddc5ee6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.969952 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f5e68-ed7d-4fdc-a46e-732ddc5ee6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.978691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5e68-ed7d-4fdc-a46e-732ddc5ee6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.980105 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f5e68-ed7d-4fdc-a46e-732ddc5ee6ed service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.989248 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1436/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:48.891505 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:48.984795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=19 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:50.261344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:50.322936 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea34bf-98c0-49ec-b3c2-7c66c0bc5321 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:50.327392 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:50.328249 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:50.328534 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:50.328811 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] PATH_INFO: `/v3/users/94a65a29858445e1a852581c60985b16` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:50.329990 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a65a29858445e1a852581c60985b16)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:50.332573 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:50.377443 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a65a29858445e1a852581c60985b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.385232 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a65a29858445e1a852581c60985b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.385890 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a65a29858445e1a852581c60985b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.386521 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a65a29858445e1a852581c60985b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.398791 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a65a29858445e1a852581c60985b16'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.411309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1423/2859] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:20:50 2022] DELETE /identity/v3/users/94a65a29858445e1a852581c60985b16 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:50.415746 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:50.416240 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:50.416352 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:50.432649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:50.433830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:50.493994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1437/2860] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:50.503697 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:50.505127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:50.562489 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b5f99-5326-466b-906b-37c3b4bcb706 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:50.566197 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c94c86-6d8e-4873-98c6-59fea171d17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:50.566886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c94c86-6d8e-4873-98c6-59fea171d17f service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:50.567175 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c94c86-6d8e-4873-98c6-59fea171d17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:50.567456 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c94c86-6d8e-4873-98c6-59fea171d17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:50.576555 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c94c86-6d8e-4873-98c6-59fea171d17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:50.577915 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c94c86-6d8e-4873-98c6-59fea171d17f service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:50.587477 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1424/2861] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:50.850781 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:50.852296 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:50.865121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659575c3-2604-4a84-b698-2f0be34878ad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:50.871058 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:50.872643 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:50.873006 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:50.873515 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] PATH_INFO: `/v3/projects/6df9d806d82d474385bfd0ddbd7d5944` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:50.874776 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df9d806d82d474385bfd0ddbd7d5944)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:50.876642 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:50.924534 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df9d806d82d474385bfd0ddbd7d5944', 'request_id': 'req-4f8ffaaf-db54-496c-8df3-b3985bfe7931'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.929878 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df9d806d82d474385bfd0ddbd7d5944', 'request_id': 'req-4f8ffaaf-db54-496c-8df3-b3985bfe7931'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.935884 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df9d806d82d474385bfd0ddbd7d5944', 'request_id': 'req-4f8ffaaf-db54-496c-8df3-b3985bfe7931'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.947647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] The token cache is being invalidate because project 6df9d806d82d474385bfd0ddbd7d5944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:20:50.947932 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.948544 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4f8ffaaf-db54-496c-8df3-b3985bfe7931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:20:50.950047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1438/2862] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:20:50 2022] DELETE /identity/v3/projects/6df9d806d82d474385bfd0ddbd7d5944 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:20:50.954909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:50.955204 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:50.955488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:50.973707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:50.974928 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:50.991547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:51.036532 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1425/2863] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:51.044208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.044498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.044778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.062514 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:51.063696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:51.071463 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1439/2864] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:51.075531 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.085954 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1902b8-80b9-42b9-9a7e-13137f5628f1 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.090581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.091228 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.091513 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.091792 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.092517 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:20:51.092826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.094523 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.106525 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1426/2865] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:20:51.110682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.119743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538a45f-6dd8-418f-8919-86622a0887cb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.124317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.124954 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.125235 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.125510 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.126194 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.128083 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.152987 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1440/2866] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:20:51 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:51.156969 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.167397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176f860-e532-41c1-98d8-374b99c99155 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.223924 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.224581 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.224864 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.225142 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.225827 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.227768 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.247640 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1427/2867] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:20:51 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:20:51.251758 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.262170 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a496b3-33f1-43fa-adb1-fb199b5aff1c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.267040 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.267695 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.267974 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.268247 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.269461 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.271095 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.281257 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1441/2868] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:51.285464 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.295027 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be41d-ee8c-4ee5-8fa7-d64f23ad51f2 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.299615 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20046873-4502-47ce-aa67-d34f9a860291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.300270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20046873-4502-47ce-aa67-d34f9a860291 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.300561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20046873-4502-47ce-aa67-d34f9a860291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.300834 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20046873-4502-47ce-aa67-d34f9a860291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.301657 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20046873-4502-47ce-aa67-d34f9a860291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.303470 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20046873-4502-47ce-aa67-d34f9a860291 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.314828 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1428/2869] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:20:51.319071 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.329041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05030821-3c1f-45f8-9784-5b4614ceb8d0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.334165 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.335067 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.335349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.335627 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] PATH_INFO: `/v3/projects/6817f6b0acec4655a9038566378c10c4/users/af72884c8a8c4d58a125b664fa8b3377/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.350961 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6817f6b0acec4655a9038566378c10c4, user_id=af72884c8a8c4d58a125b664fa8b3377, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.353539 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.365677 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1442/2870] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:20:51 2022] PUT /identity/v3/projects/6817f6b0acec4655a9038566378c10c4/users/af72884c8a8c4d58a125b664fa8b3377/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:20:51.370613 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837b19e-766c-4618-9e15-7f57e8abd0c9 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.370896 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837b19e-766c-4618-9e15-7f57e8abd0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.371178 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837b19e-766c-4618-9e15-7f57e8abd0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.388759 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-0837b19e-766c-4618-9e15-7f57e8abd0c9 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:51.389961 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-0837b19e-766c-4618-9e15-7f57e8abd0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:51.447974 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1429/2871] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:51.458536 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:51.460215 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:51.481623 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:51.518436 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e60493-5166-415b-a2a0-988ecd0bd20c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:51.522899 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:51.523543 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:51.523830 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:51.524114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:51.533003 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:51.534457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:51.543994 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1443/2872] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:52.117676 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dc4df-6440-4bf9-8a95-5aebbb871816 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:52.118023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dc4df-6440-4bf9-8a95-5aebbb871816 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:52.118354 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dc4df-6440-4bf9-8a95-5aebbb871816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:52.145414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-892dc4df-6440-4bf9-8a95-5aebbb871816 None None] MFA Rules not processed for user `af72884c8a8c4d58a125b664fa8b3377`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:52.146707 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-892dc4df-6440-4bf9-8a95-5aebbb871816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:52.163762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:52.214372 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1430/2873] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:52.225721 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:52.227121 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:52.289599 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f9f67-f66e-4356-bbd2-28fcacd77183 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:52.293264 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:52.293907 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:52.294190 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:52.294494 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:52.303482 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:52.304883 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:52.313792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1444/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:53.702127 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6532ced-7d3e-4351-a556-845fa16f0832 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:53.702733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6532ced-7d3e-4351-a556-845fa16f0832 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:53.702733 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6532ced-7d3e-4351-a556-845fa16f0832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:53.719858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d6532ced-7d3e-4351-a556-845fa16f0832 None None] MFA Rules not processed for user `af72884c8a8c4d58a125b664fa8b3377`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:20:53.721033 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d6532ced-7d3e-4351-a556-845fa16f0832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:53.728394 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1431/2875] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:20:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:20:56.078854 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:56.088819 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670049cb-4bbb-4819-92de-6b14b1a63c1e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:56.092425 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:56.093059 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:56.093346 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:56.093630 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:56.095415 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:56.104848 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:56.106260 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:56.114269 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1445/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:03.714614 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=22 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:06.110657 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=49 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:07.487026 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:07.488131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:07.488131 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:07.505995 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] MFA Rules not processed for user `af72884c8a8c4d58a125b664fa8b3377`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:07.507323 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:07.514547 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1432/2877] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:21:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:15.095636 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:15.097080 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:15.172207 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c4116-5f46-497f-9a02-da2c50e7bba8 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:15.177783 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:15.178481 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:15.178759 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:15.179064 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:15.180826 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:15.192799 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:15.194412 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23db36-74f4-40df-9f91-b2822835aefa service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:15.204939 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1446/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:17.500279 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:19.672052 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:19.685194 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693515d-ee86-4b20-9f9a-5ddc56744fe7 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:19.690838 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '572e1cbd83cb43c396cd474079633af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:19.691530 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.691852 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.692138 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.693968 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:19.707023 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:19.709209 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.720626 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1433/2879] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:22.809316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d151df9-6bed-4cf5-abbf-833cb4d292e6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:22.809828 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d151df9-6bed-4cf5-abbf-833cb4d292e6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:22.809948 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d151df9-6bed-4cf5-abbf-833cb4d292e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:22.828286 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8d151df9-6bed-4cf5-abbf-833cb4d292e6 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:22.829473 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8d151df9-6bed-4cf5-abbf-833cb4d292e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:22.886617 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1447/2880] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jun 24 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:22.932619 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:22.934025 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:23.002886 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c21eda-b18a-437d-94f3-9060d907e8e5 service nova] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:23.008807 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:23.009454 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:23.009737 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:23.010010 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:23.018655 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:23.020222 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:23.028982 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1434/2881] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:21:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:32.878726 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=59 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:33.025734 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=38 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:37.441362 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:37.441824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:37.441933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:37.460669 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] MFA Rules not processed for user `6948dca9b9bf40ed8e2195c463a49d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:37.461859 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:37.469010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1448/2882] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jun 24 09:21:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:37.481344 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:37.492413 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edc5c3-b914-4e15-912b-88eff4c68ce1 service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:37.497365 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aef646744cb34d9eb6068cb54a31315e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:37.497987 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:37.498306 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:37.498586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:37.506620 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:37.508200 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:37.516648 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1435/2883] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jun 24 09:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:39.330610 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:39.332119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:39.382846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:39.397563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838ca37-3a65-4127-b42d-1deb36be68ed service swift] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:39.402790 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:39.403889 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:39.404215 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:39.404639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] PATH_INFO: `/v3/users/af72884c8a8c4d58a125b664fa8b3377` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:39.407859 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=af72884c8a8c4d58a125b664fa8b3377)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:39.410074 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:39.413743 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff68f53-4e69-49a2-8055-aab01f9a8a28 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:39.420171 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:39.420831 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:39.421106 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:39.421382 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:39.423620 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:39.435471 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:39.437144 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:39.447873 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1449/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:39.462189 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af72884c8a8c4d58a125b664fa8b3377'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:39.469353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af72884c8a8c4d58a125b664fa8b3377'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:39.470017 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af72884c8a8c4d58a125b664fa8b3377'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:39.470651 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af72884c8a8c4d58a125b664fa8b3377'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:39.483093 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-c1e5f629-d4e2-447f-9c1c-1f1ec32906ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af72884c8a8c4d58a125b664fa8b3377'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:39.496109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1436/2885] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:39 2022] DELETE /identity/v3/users/af72884c8a8c4d58a125b664fa8b3377 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:21:39.884444 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:39.898737 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eed1cc-e234-4b99-af14-91ba33ae9d9d service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:39.955691 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:39.956546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:39.956835 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:39.957116 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] PATH_INFO: `/v3/projects/6817f6b0acec4655a9038566378c10c4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:39.958863 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6817f6b0acec4655a9038566378c10c4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:39.960750 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.007784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6817f6b0acec4655a9038566378c10c4', 'request_id': 'req-3c5a79f9-c485-4be6-b1d5-09a79c093825'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:40.014099 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6817f6b0acec4655a9038566378c10c4', 'request_id': 'req-3c5a79f9-c485-4be6-b1d5-09a79c093825'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:40.020511 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6817f6b0acec4655a9038566378c10c4', 'request_id': 'req-3c5a79f9-c485-4be6-b1d5-09a79c093825'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:40.032916 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] The token cache is being invalidate because project 6817f6b0acec4655a9038566378c10c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:40.033208 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:40.033834 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c5a79f9-c485-4be6-b1d5-09a79c093825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:40.035399 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1450/2886] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:39 2022] DELETE /identity/v3/projects/6817f6b0acec4655a9038566378c10c4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:40.040241 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.040540 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.040826 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.058610 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:40.059808 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:40.119214 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1437/2887] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:40.127803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.128028 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.128307 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.146457 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:40.147646 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:40.155478 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1451/2888] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:40.159597 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.169683 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9272b-650b-4fe9-91bf-572092c4f2f0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.174155 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.174825 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.175109 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.175389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.176112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:21:40.176490 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.178077 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.189245 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1438/2889] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:21:40.193860 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.203632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4f1b-39e3-4979-aaad-641d86ca99ac None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.208833 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.209470 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.209755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.210034 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.210755 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.212625 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.215778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:40.240001 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1452/2890] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:40 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:40.244069 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.253718 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34d952-0276-4739-ab0b-ad868d01ea1c admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.296724 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:40.311072 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.311740 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.312028 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.312309 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.313015 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.314976 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.333962 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1439/2891] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:40 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:40.338177 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.348984 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9543a8-1037-446d-ad19-d154c48ca768 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.353615 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.354299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.354589 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.354866 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.355602 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.357174 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.367498 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1453/2892] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:21:40.371270 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.381073 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563388bb-6e60-4dfa-9ca7-278382cb9aa4 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.385877 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe497b1-09db-4bd4-8daa-5463d9a36175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.386563 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe497b1-09db-4bd4-8daa-5463d9a36175 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.386845 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe497b1-09db-4bd4-8daa-5463d9a36175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.387119 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe497b1-09db-4bd4-8daa-5463d9a36175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.387847 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe497b1-09db-4bd4-8daa-5463d9a36175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.389414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe497b1-09db-4bd4-8daa-5463d9a36175 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.399078 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1440/2893] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:21:40.403014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.414047 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f18d15-e64e-494b-8105-c9814fe2d326 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.418748 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.419632 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.419933 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.420204 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] PATH_INFO: `/v3/projects/3738fc3890b04c47ac9f7c5f8f878221/users/80cb8f9776d64712ac8d0601b57f0646/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.435166 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3738fc3890b04c47ac9f7c5f8f878221, user_id=80cb8f9776d64712ac8d0601b57f0646, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.437792 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.450280 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1454/2894] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:40 2022] PUT /identity/v3/projects/3738fc3890b04c47ac9f7c5f8f878221/users/80cb8f9776d64712ac8d0601b57f0646/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:40.459975 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.460264 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.460543 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.486455 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] MFA Rules not processed for user `80cb8f9776d64712ac8d0601b57f0646`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:40.487639 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:40.551762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1441/2895] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:21:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:40.562795 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:40.564493 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:40.628784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92489bf-27f9-4ba0-bda2-11a561483af6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:40.632806 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376cdd63-0c77-452b-8651-65c491f4f3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:40.633405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cdd63-0c77-452b-8651-65c491f4f3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:40.633696 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cdd63-0c77-452b-8651-65c491f4f3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:40.634397 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cdd63-0c77-452b-8651-65c491f4f3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:40.643366 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cdd63-0c77-452b-8651-65c491f4f3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:40.644798 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376cdd63-0c77-452b-8651-65c491f4f3a9 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:40.665800 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1455/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:50.548929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:50.650648 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:11.146576 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:11.206848 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c6b6b-28a1-4fad-840c-9dd08a63261a None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:11.211329 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:11.212211 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.212492 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.212766 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] PATH_INFO: `/v3/users/80cb8f9776d64712ac8d0601b57f0646` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.213947 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cb8f9776d64712ac8d0601b57f0646)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:11.215885 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:11.261243 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cb8f9776d64712ac8d0601b57f0646'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.267920 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cb8f9776d64712ac8d0601b57f0646'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.268572 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cb8f9776d64712ac8d0601b57f0646'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.269168 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cb8f9776d64712ac8d0601b57f0646'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.280635 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cb8f9776d64712ac8d0601b57f0646'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.292770 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1442/2897] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:22:11 2022] DELETE /identity/v3/users/80cb8f9776d64712ac8d0601b57f0646 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:22:11.297187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.297682 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.297796 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.315131 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:22:11.316114 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:11.381037 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1456/2898] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:22:11.391544 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:11.392970 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:11.449700 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c697fc8-37bf-4e3e-b329-f187c98cac88 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:11.453353 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86712f-7f5a-4ea8-94ae-4d2f9120b89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:11.453992 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86712f-7f5a-4ea8-94ae-4d2f9120b89e service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.454300 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86712f-7f5a-4ea8-94ae-4d2f9120b89e service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.454578 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86712f-7f5a-4ea8-94ae-4d2f9120b89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.463433 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86712f-7f5a-4ea8-94ae-4d2f9120b89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:11.464839 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86712f-7f5a-4ea8-94ae-4d2f9120b89e service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:11.474022 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1443/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:22:11.734216 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:11.735723 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:11.748299 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0245-29b5-4050-ba08-61c41a8fc0b1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:11.752929 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:11.753811 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.754100 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.754414 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] PATH_INFO: `/v3/projects/3738fc3890b04c47ac9f7c5f8f878221` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.755612 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3738fc3890b04c47ac9f7c5f8f878221)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:11.757517 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:11.804583 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3738fc3890b04c47ac9f7c5f8f878221', 'request_id': 'req-c36b4b67-068c-433e-83c7-e7dbd5e563fc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.810778 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3738fc3890b04c47ac9f7c5f8f878221', 'request_id': 'req-c36b4b67-068c-433e-83c7-e7dbd5e563fc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.816964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3738fc3890b04c47ac9f7c5f8f878221', 'request_id': 'req-c36b4b67-068c-433e-83c7-e7dbd5e563fc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.828638 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] The token cache is being invalidate because project 3738fc3890b04c47ac9f7c5f8f878221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:22:11.828928 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.829546 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c36b4b67-068c-433e-83c7-e7dbd5e563fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:11.831109 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1457/2900] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:22:11 2022] DELETE /identity/v3/projects/3738fc3890b04c47ac9f7c5f8f878221 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:22:11.836041 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.836339 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.836682 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.854600 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:22:11.855789 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:11.874495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:11.918814 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1444/2901] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:22:11.926439 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.926731 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.927014 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.944824 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:22:11.946010 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:11.954093 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1458/2902] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:22:11.958100 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:11.968286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a2b38-9304-4def-b8dd-8b3b078c11af None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:11.972977 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:11.973621 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:11.973909 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:11.974192 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:11.974949 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80254) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:22:11.975261 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:11.976858 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:11.988912 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1445/2903] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jun 24 09:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:22:11.992989 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.002123 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8cfc-3e43-493b-be68-8f9e42ae845e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.006857 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.007496 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.007779 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.008054 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.008768 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.010967 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.036760 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1459/2904] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jun 24 09:22:11 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:22:12.041509 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.051397 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6c4c4-e7fb-475e-9a6d-fb80211a6992 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.106806 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.107468 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.107751 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.108034 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] PATH_INFO: `/v3/users` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.108717 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.110691 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.130063 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1446/2905] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jun 24 09:22:12 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:22:12.134244 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.144712 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63188-8b85-40f8-ba73-e53c6b4c5598 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.149794 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.150469 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.150754 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.151078 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.151803 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.153381 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.164564 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1460/2906] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:22:12.168929 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.178971 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9f36c-be4f-4c48-a46f-69ac4e854dea admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.183764 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249a93a-fa0a-48c6-b72e-527819b79266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.184414 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249a93a-fa0a-48c6-b72e-527819b79266 admin admin] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.184699 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249a93a-fa0a-48c6-b72e-527819b79266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.184979 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249a93a-fa0a-48c6-b72e-527819b79266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.185765 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249a93a-fa0a-48c6-b72e-527819b79266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.187378 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249a93a-fa0a-48c6-b72e-527819b79266 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.197218 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1447/2907] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jun 24 09:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:22:12.200956 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.210635 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e5845-bdc9-4f09-887d-511fbafde3f3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.215709 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.216569 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.216849 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.217124 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] PATH_INFO: `/v3/projects/e0c425f761cf4a9290c47e197716f981/users/e3f5024407384e6eaded914758748e0e/roles/f60d92c63c684ab6b89b982e4049558a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.232316 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c425f761cf4a9290c47e197716f981, user_id=e3f5024407384e6eaded914758748e0e, role_id=f60d92c63c684ab6b89b982e4049558a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.234981 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.247572 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1461/2908] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jun 24 09:22:12 2022] PUT /identity/v3/projects/e0c425f761cf4a9290c47e197716f981/users/e3f5024407384e6eaded914758748e0e/roles/f60d92c63c684ab6b89b982e4049558a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:22:12.259130 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] REQUEST_METHOD: `POST` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.259673 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.259952 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.286643 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.auth.core [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] MFA Rules not processed for user `e3f5024407384e6eaded914758748e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80254) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:22:12.287846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:12.351556 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1448/2909] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:22:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:22:12.362649 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.364349 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:12.386443 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:12.422867 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a0a60-a7c3-4b4c-8661-a2a427939e98 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.426508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb4a0-25f5-4003-ad16-66ccba845785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78768c5fb13646dcad006e323df270a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.427150 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb4a0-25f5-4003-ad16-66ccba845785 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.427441 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb4a0-25f5-4003-ad16-66ccba845785 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.427718 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb4a0-25f5-4003-ad16-66ccba845785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.435964 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb4a0-25f5-4003-ad16-66ccba845785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.437375 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb4a0-25f5-4003-ad16-66ccba845785 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.446647 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1462/2910] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:22:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:22:12.471983 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.490667 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:12.534907 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605748d-d04e-4c37-bf3f-1fd7dc3339f0 None None] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.539500 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.540389 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.540674 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.540953 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] PATH_INFO: `/v3/users/e3f5024407384e6eaded914758748e0e` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.542146 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f5024407384e6eaded914758748e0e)` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.544126 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.590630 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f5024407384e6eaded914758748e0e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:12.597420 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f5024407384e6eaded914758748e0e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:12.598112 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f5024407384e6eaded914758748e0e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:12.598762 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f5024407384e6eaded914758748e0e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:12.610670 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.notifications [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f5024407384e6eaded914758748e0e'} {{(pid=80254) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:12.623761 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1449/2911] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jun 24 09:22:12 2022] DELETE /identity/v3/users/e3f5024407384e6eaded914758748e0e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:22:12.628221 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.628508 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.628784 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.646652 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] MFA Rules not processed for user `6a27e99cfbbf4208a8877f4098e73599`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:22:12.647864 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:12.704317 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1463/2912] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jun 24 09:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:22:12.713748 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:12.715128 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:12.771646 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5fbe6-3205-4d2b-b308-03e922a1b149 admin admin] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:12.775371 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ec4a5d37c914c5e8296aa9e14c9c3f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:12.776005 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:12.776286 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:12.776586 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:12.785561 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:12.787001 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:12.796304 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1450/2913] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:22:13.054018 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:22:13.056119 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:22:13.067983 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b08ba-3dc0-4a52-8fec-30e9a396b043 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:22:13.072553 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a27e99cfbbf4208a8877f4098e73599', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2c438c1ae4c4814acf705cd2b5ad9d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:22:13.073405 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:22:13.073683 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:22:13.073953 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] PATH_INFO: `/v3/projects/e0c425f761cf4a9290c47e197716f981` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:22:13.075304 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c425f761cf4a9290c47e197716f981)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:22:13.077126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:22:13.123126 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c425f761cf4a9290c47e197716f981', 'request_id': 'req-0aed2d3f-dfab-4554-b702-9d6187064dbe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:13.128590 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c425f761cf4a9290c47e197716f981', 'request_id': 'req-0aed2d3f-dfab-4554-b702-9d6187064dbe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:13.135163 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c425f761cf4a9290c47e197716f981', 'request_id': 'req-0aed2d3f-dfab-4554-b702-9d6187064dbe'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:13.147187 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] The token cache is being invalidate because project e0c425f761cf4a9290c47e197716f981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:22:13.147416 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:13.148041 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0aed2d3f-dfab-4554-b702-9d6187064dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:22:13.149605 dv-cinder-845990-4-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1464/2914] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jun 24 09:22:13 2022] DELETE /identity/v3/projects/e0c425f761cf4a9290c47e197716f981 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:22:22.792217 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:23.143966 dv-cinder-845990-4-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:08.463071 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] Authenticating user token {{(pid=80254) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:08.464495 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:08.601931 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8cde-2954-4440-b9e5-849ec1d439f2 service neutron] Validating token access rules against request {{(pid=80254) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:08.660281 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2b5e5bb5b614905b7ff314b54bf8097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '538ff438321a4f52a44f39f24a097997', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80254) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:08.660927 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] REQUEST_METHOD: `GET` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:08.661213 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] SCRIPT_NAME: `/identity` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:08.661488 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80254) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:08.663407 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.fernet_utils [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80254) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:08.674469 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:08.676045 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd61e50-7a6e-4243-a1a1-6590678b30fe service placement] RBAC: Authorization granted {{(pid=80254) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:08.685846 dv-cinder-845990-4-smb devstack@keystone.service[80254]: [pid: 80254|app: 0|req: 1451/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jun 24 09:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:23:18.681836 dv-cinder-845990-4-smb devstack@keystone.service[80254]: DEBUG dbcounter [-] [80254] Writing DB stats keystone:SELECT=89 {{(pid=80254) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}